-- Logs begin at Mon 2022-08-22 13:18:04 UTC, end at Mon 2022-08-22 14:23:46 UTC. -- Aug 22 13:56:11.058339 dv-osbrick-849020-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 13:56:11.068992 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 13:56:11 2022] *** Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: nodename: dv-osbrick-849020-5-ceph Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: machine: x86_64 Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: clock source: unix Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: pcre jit disabled Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: detected number of CPU cores: 4 Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: current working directory: / Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: detected binary path: /usr/bin/uwsgi-core Aug 22 13:56:11.071128 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: your processes number limit is 47680 Aug 22 13:56:11.071768 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: your memory page size is 4096 bytes Aug 22 13:56:11.071768 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: detected max file descriptor number: 2048 Aug 22 13:56:11.071768 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: lock engine: pthread robust mutexes Aug 22 13:56:11.071768 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: thunder lock: enabled Aug 22 13:56:11.071768 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 13:56:11.071768 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 13:56:11.115596 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: Python main interpreter initialized at 0x558927dba9c0 Aug 22 13:56:11.115596 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: python threads support enabled Aug 22 13:56:11.115596 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: your server socket listen backlog is limited to 100 connections Aug 22 13:56:11.115596 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: your mercy for graceful operations on workers is 90 seconds Aug 22 13:56:11.115997 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 13:56:11.116081 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: *** Operational MODE: preforking *** Aug 22 13:56:11.116322 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: *** uWSGI is running in multiple interpreter mode *** Aug 22 13:56:11.116322 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: spawned uWSGI master process (pid: 88403) Aug 22 13:56:11.116588 dv-osbrick-849020-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 22 13:56:11.117860 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: spawned uWSGI worker 1 (pid: 88413, cores: 1) Aug 22 13:56:11.117860 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: spawned uWSGI worker 2 (pid: 88414, cores: 1) Aug 22 13:56:11.117860 dv-osbrick-849020-5-ceph devstack@keystone.service[88403]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 13:56:15.731922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 13:56:15.731922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: from cryptography.utils import int_from_bytes Aug 22 13:56:15.732753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 13:56:15.732753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: from cryptography.utils import int_from_bytes Aug 22 13:56:15.732863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 13:56:15.732863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: from cryptography.utils import int_from_bytes Aug 22 13:56:15.732863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 13:56:15.732863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: from cryptography.utils import int_from_bytes Aug 22 13:56:15.782532 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 13:56:15.782707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 13:56:15.782801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 13:56:15.782877 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 13:56:15.782944 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] command line args: [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 13:56:15.783091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] command line args: [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 13:56:15.783234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 13:56:15.783389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ================================================================================ {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 13:56:15.783484 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 13:56:15.783602 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] admin_token = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.783692 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ================================================================================ {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 13:56:15.783849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] config_dir = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] admin_token = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784138 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] config_source = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] config_dir = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] debug = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784545 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] config_source = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.784941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] debug = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785176 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785438 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785566 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785639 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785821 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.785946 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786071 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786156 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786381 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_config_append = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786475 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_config_append = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786589 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786670 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786772 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_dir = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786855 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_dir = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.786956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_file = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787029 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_file = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.787884 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788228 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788514 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788677 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788808 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.788937 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789108 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.789898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790029 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790534 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.790834 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] publish_errors = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791251 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791733 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791810 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] publish_errors = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791886 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.791958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792076 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] standard_threads = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792415 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792773 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792897 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.792975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793046 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] standard_threads = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] use_journal = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793362 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] use_json = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793438 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] use_stderr = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793583 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] use_syslog = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] use_journal = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.793924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.794014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] use_json = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.794090 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.794167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] use_stderr = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.794239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.794318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] use_syslog = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.794515 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 13:56:15.794636 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.794727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.794808 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.794988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795128 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.795967 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796165 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796266 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796589 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796708 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.796942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797064 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797219 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797458 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797583 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797739 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797854 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.797975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798335 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.798992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.799104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.799215 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.799326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.799445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.799558 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800019 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800139 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800619 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800848 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.800960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801080 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801223 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801808 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.801923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802144 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802144 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802361 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802814 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.802926 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803269 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803497 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803721 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803721 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.803939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804058 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.804932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805792 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.805903 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806247 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806477 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.806983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807233 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807352 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.807930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.808999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809392 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809629 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809866 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.809989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810235 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810810 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.810922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811163 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811502 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.811972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812441 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812594 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812749 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.812978 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813256 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813371 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813613 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813838 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.813951 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814417 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814535 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814763 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.814887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815408 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815881 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.815995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816108 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816751 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816863 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.816976 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817103 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817256 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817495 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817608 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.817944 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818064 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818178 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818292 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818516 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.818969 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819082 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819194 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.external = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.819983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.external = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820241 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.password = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] auth.token = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820695 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820808 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.820929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821044 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.password = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] auth.token = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821794 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.821907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822134 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822695 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822809 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.822921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.823947 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824879 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.824993 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825251 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825367 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825592 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.825949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.826987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827111 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827691 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.827934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828515 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828637 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828637 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.828964 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829353 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829585 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829698 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.829812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830237 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830351 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.830932 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831272 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831393 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.831962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832083 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832199 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832426 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.832997 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833114 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833245 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833474 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.833995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834347 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.834903 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835148 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835511 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835632 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835774 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.835894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836667 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.836895 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837737 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837737 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.837964 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838080 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838307 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.838886 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839350 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839455 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839558 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839670 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.839896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840253 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840366 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840592 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840714 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.840942 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.841886 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842131 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842475 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842824 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.842938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843051 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843166 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843279 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843744 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.843920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844035 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844503 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.844968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845082 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845355 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.845941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846291 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.846994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847567 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.847919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848248 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848248 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.848923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849146 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849146 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849606 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.849960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850073 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850185 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850303 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850868 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.850982 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851103 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851572 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851809 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.851924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852038 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] role.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] role.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852563 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] role.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.852914 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] role.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853140 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853341 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853572 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.853921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854038 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854271 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.854962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855075 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855425 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855538 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855765 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855878 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.855999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856341 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856454 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856805 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.856917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857030 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857144 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.857971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858207 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858321 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858434 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.858898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859863 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.859977 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860099 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860433 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.860998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861239 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861598 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861712 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861828 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.861941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862178 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862293 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862414 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862529 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.862979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.863896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864350 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864464 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.connection = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.864937 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865050 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865050 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865286 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.connection = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865762 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.865994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866108 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866222 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866222 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866779 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.866892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867118 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867592 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867706 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.867931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868166 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868393 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868505 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.868974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 13:56:15.869088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.869088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 13:56:15.869088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 13:56:15.895508 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.895735 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.895825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.895963 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.896045 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.896184 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.904246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.904487 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.933844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.934020 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.935998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.936233 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.986129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:15.986298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.033899 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.034118 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.034506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.034703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.100543 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.100717 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.100850 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.100950 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101325 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.101666 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.124337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.124494 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.124632 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.124777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.124855 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.124917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125157 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125302 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125439 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.125907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.136450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.136764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.149155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.149412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.149615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.149709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.149822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150039 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150307 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150450 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150592 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.150798 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.151012 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 13:56:16.167383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.167601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 13:56:16.167742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.167838 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 13:56:16.167913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.168141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 13:56:16.168265 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.168400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 13:56:16.168476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.168552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.168626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.168847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.168972 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.169105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.169220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.169344 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.178983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.179261 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.179383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.179518 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.179618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.179743 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.179944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.180200 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.186670 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.187322 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.189568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.189849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.190132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.190254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.190411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.190495 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.190681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.190804 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.190939 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191190 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191794 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.191986 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.192110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.192282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.192406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.192583 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.192853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.216525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.216971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.217994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.218274 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.218549 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.218833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.222794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.223081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.223355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.223496 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.223633 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.223896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.229902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.230189 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.230413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.230704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.234177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.234516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.234796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.234918 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.235064 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.235186 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.235318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.235496 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.235715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.235852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.235987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.236106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.236220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.236426 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.236705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.236963 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.251771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.252049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.252593 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.252874 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.256057 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.256759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.259153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.259448 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.259867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.260158 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.263754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.264490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.266898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.267650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.270016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.270312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.270671 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.270819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.270962 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.271063 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.271186 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.271301 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.271578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.271702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.271852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.272224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.287391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.287659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.287941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.288081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.288219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.288339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.288453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.288741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.294846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.295466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.296515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.296788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.297150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.297452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.299451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.300111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.300395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.300531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.300669 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.300742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.300935 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.301060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.301432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.301752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.312225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.312507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.312851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.312975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.313112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.313337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.313475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.313610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.313740 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.313820 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.313890 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.314123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.314402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.314680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.329507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.330339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.332483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.333479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.335751 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.336718 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.337200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.338183 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.338655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.338936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.339212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.339702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.339987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.340270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.345804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.346804 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.347248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.348270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.350228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.350513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.350839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.351062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.351150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.351416 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.351688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.351967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.360081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.360365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.360638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.361045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.361367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.361651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.367459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.367845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.368125 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.368346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 13:56:16.368470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.368671 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.368794 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.368944 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369763 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.369888 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370119 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370662 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.370876 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.371035 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.371160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.371359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.371635 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.371882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 13:56:16.403887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558927dba9c0 pid: 88414 (default app) Aug 22 13:56:16.404640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558927dba9c0 pid: 88413 (default app) Aug 22 13:56:16.407403 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d1775-3fcf-41a4-9839-ee789bf537e3 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:16.407689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d1775-3fcf-41a4-9839-ee789bf537e3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:16.407959 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d1775-3fcf-41a4-9839-ee789bf537e3 None None] PATH_INFO: `/v3` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:16.412322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Mon Aug 22 13:56:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:23.489851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:23.490389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:23.490663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:23.495783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:23.503323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:23.503798 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:23.503878 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:23.580060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: INFO dbcounter [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] Registered counter for database keystone Aug 22 13:56:23.602841 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG oslo_db.sqlalchemy.engines [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 13:56:23.614697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writer thread running {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 13:56:23.804198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG passlib.handlers.bcrypt [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88414) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 13:56:23.804513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG passlib.handlers.bcrypt [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88414) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 13:56:23.862208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:23.863848 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:24.037648 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 13:56:24.567177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:24.652240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: INFO dbcounter [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] Registered counter for database keystone Aug 22 13:56:24.678894 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG oslo_db.sqlalchemy.engines [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 13:56:24.686870 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writer thread running {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 13:56:24.807480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec74c-1c60-4ac8-aaaf-f691e9c41367 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:24.812199 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:24.812768 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:24.813044 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:24.813343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:24.822306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:24.873735 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 13:56:24.874075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25573b6-685e-467f-87d0-e247c3073ce5 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:24.884825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Aug 22 13:56:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 13:56:24.891203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:24.908646 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583d35f-2564-4482-a44d-c89fe595b65e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:24.913604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:24.914734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:24.914990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:24.915263 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] PATH_INFO: `/v3/projects/5aa389fb5583459aa825686b80b028ae` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:24.916781 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] RBAC: Authorizing `identity:get_project(project_id=5aa389fb5583459aa825686b80b028ae)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:24.967046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 13:56:24.967377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cf696-8fe1-424f-abba-b33c5c6a7f9e admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:24.972155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Mon Aug 22 13:56:24 2022] GET /identity/v3/projects/5aa389fb5583459aa825686b80b028ae => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:27.204994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4313-f5a6-45ed-bbc9-4ee2bb0c2313 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:27.205673 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4313-f5a6-45ed-bbc9-4ee2bb0c2313 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:27.205673 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4313-f5a6-45ed-bbc9-4ee2bb0c2313 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:27.209828 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:27.215727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:27.216169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:27.216260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:27.237404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:27.238970 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:27.248000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 13:56:27.575989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4313-f5a6-45ed-bbc9-4ee2bb0c2313 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:27.590946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4313-f5a6-45ed-bbc9-4ee2bb0c2313 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:27.596011 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5956a5-a125-4b30-8ee8-da12a2a1180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:27.596616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5956a5-a125-4b30-8ee8-da12a2a1180b admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:27.596900 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5956a5-a125-4b30-8ee8-da12a2a1180b admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:27.597169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5956a5-a125-4b30-8ee8-da12a2a1180b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:27.605062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5956a5-a125-4b30-8ee8-da12a2a1180b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:27.606879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5956a5-a125-4b30-8ee8-da12a2a1180b admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:27.615671 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Aug 22 13:56:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 13:56:27.621899 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:27.633684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0033d-746e-4077-8899-d274f3b11721 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:27.639534 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8adb19-2416-4cf9-ba13-be1624cbbebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:27.640168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8adb19-2416-4cf9-ba13-be1624cbbebc admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:27.640448 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8adb19-2416-4cf9-ba13-be1624cbbebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:27.640721 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8adb19-2416-4cf9-ba13-be1624cbbebc admin admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:27.642559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8adb19-2416-4cf9-ba13-be1624cbbebc admin admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:27.644527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8adb19-2416-4cf9-ba13-be1624cbbebc admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:27.646070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Mon Aug 22 13:56:27 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:29.888586 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2f48-8c4a-4e75-957c-fcef66b0eb7f None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:29.889112 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2f48-8c4a-4e75-957c-fcef66b0eb7f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:29.889112 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2f48-8c4a-4e75-957c-fcef66b0eb7f None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:29.890396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:29.895778 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66016a2a-b9ef-4b5a-943f-4b02096a6dd7 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:29.896214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66016a2a-b9ef-4b5a-943f-4b02096a6dd7 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:29.896298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:29.896393 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66016a2a-b9ef-4b5a-943f-4b02096a6dd7 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:29.896488 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:29.896668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:29.898424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:29.906449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:29.906908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:29.907309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:29.926661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:29.927863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:29.945479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG passlib.handlers.bcrypt [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 13:56:29.945895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG passlib.handlers.bcrypt [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 13:56:29.992252 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:29.993943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:30.127570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:30.137580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:30.446878 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:30.477822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:30.507546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:30.563796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:30.567295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd9b0-fc86-44ff-97f0-688107eedf3f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:30.591011 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fc26c-c9d2-4596-8edd-e18efbf1e82f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:30.605758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:30.606648 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:30.606928 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:30.607204 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:30.625718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:30.626359 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:30.626636 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:30.626955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:30.638225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:30.647032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:30.647987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:30.648807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 8/14] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:56:30.653995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:30.680725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:30.682308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:30.740955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:30.756881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4efd3-f419-4f55-bf6e-cb87ffbca152 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:30.776221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:30.781339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 7/15] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:56:30.785866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:30.791356 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:30.791968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:30.792245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:30.792515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:30.793508 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:30.793508 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:30.794888 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:30.807168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 9/16] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:30.812658 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:30.882615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef694832-ac2b-4415-90cb-792f3066865e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:30.909945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a02c0-ca37-462d-9b63-9ea7a070d4f3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:30.917553 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:30.918417 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:30.918695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:30.918969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:30.939425 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:30.940903 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:30.945030 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:30.945712 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:30.946004 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:30.946267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:30.947389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:30.948805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:30.950398 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 10/17] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:30 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:30.955925 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:30.975465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:31.065225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ff710-b312-4e61-9058-f32f1da9cb90 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:56:31.071004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:31.071887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:56:31.072683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:56:31.072683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:56:31.072683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:56:31.072683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 8/18] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:56:31.078150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:31.102325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:31.102965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:31.103246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:31.103515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:31.104638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:31.106124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:31.107689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 11/19] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:31.113470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:31.131858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:31.178859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406f01-4395-4029-abf9-486a58c47403 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:31.195772 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:31.211397 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83898bc9-84ef-4a9b-ad8b-c605d0e6449e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:31.212589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:31.213395 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:31.213684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:31.213960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:31.214607 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:31.214911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:31.216322 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d8a5-3bcf-4602-b3bf-b6aa85adb037 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:31.234882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 9/20] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:31.246334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:31.246974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:31.247252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:31.247520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:31.248270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.domain.id=default, user.id=8875dd4e092c4727887ccb9579eeb3e4) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:31.248575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:31.250195 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9ebe-3ade-4b49-9c3f-9b6c493db244 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:31.258710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 12/21] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Aug 22 13:56:31 2022] GET /identity/v3/role_assignments?user.id=8875dd4e092c4727887ccb9579eeb3e4&scope.domain.id=default&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:34.075399 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63558f1-3f9f-45be-bb8b-0aa3fdf6d252 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.075967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63558f1-3f9f-45be-bb8b-0aa3fdf6d252 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.075967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63558f1-3f9f-45be-bb8b-0aa3fdf6d252 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.077550 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 10/22] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:34.083390 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f0976-1990-41b3-abf2-a2411b683a38 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.083871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f0976-1990-41b3-abf2-a2411b683a38 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.083974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f0976-1990-41b3-abf2-a2411b683a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.121170 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-180f0976-1990-41b3-abf2-a2411b683a38 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:34.122411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-180f0976-1990-41b3-abf2-a2411b683a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:34.198480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:56:34.532020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223b2f-09ce-49d4-9d36-77d355f8bd56 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.532020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223b2f-09ce-49d4-9d36-77d355f8bd56 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.532020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223b2f-09ce-49d4-9d36-77d355f8bd56 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.532893 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 11/24] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:34.546953 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.547241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.547501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.574907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:34.576115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:34.602867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e868e6-212f-4b36-9733-de3aed53b25d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.603512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e868e6-212f-4b36-9733-de3aed53b25d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.603987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e868e6-212f-4b36-9733-de3aed53b25d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.605950 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 12/25] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:34.611297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.611992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.612498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.644050 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:34.645727 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:34.741929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 14/26] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:34.743258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:34.769578 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:34.800683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 13/27] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:34.893790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fe7f-3208-4c61-b124-425eda08bd25 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:34.929971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:34.930627 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:34.930913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:34.931189 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:34.942654 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:34.944176 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-5bde7163-02fe-4ec6-b864-0d1ba0e416c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:56:34.960660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:34.962219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:56:34.963179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:56:34.963179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:56:34.963179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:34.963179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 15/28] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:34.970461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:35.047660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:35.053834 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ac49f-3ace-45d5-8a8c-da38c2a401a4 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.054376 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ac49f-3ace-45d5-8a8c-da38c2a401a4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.054842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ac49f-3ace-45d5-8a8c-da38c2a401a4 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.056373 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 16/29] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:35.061549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.062072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.062538 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.112656 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:35.116916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:35.186231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414878b-aad3-4216-9728-02d89cadb1f5 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:35.244441 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:35.246962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.247675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.248926 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.250080 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:35.253657 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:35.255382 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:35.263622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:35.281790 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 14/30] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:35.283528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:35.296457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:56:35.297750 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:35.462265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47806953-61c4-47c4-8798-503f35e581f1 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:35.510621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:35.511857 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.512402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.512867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.525589 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:35.533123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:35.534275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:35.535246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:35.535964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95287f81-9630-4354-8bc2-22cfa132bb66 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:35.536530 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:35.538995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 18/32] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:56:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:35.540220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:35.641939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:35.642774 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.643050 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.643319 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.643989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:35.645553 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:35.649641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:35.715967 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82e57-4bde-4843-b554-3fd651c01bf7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:35.762873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753c656-03b0-4005-8811-8b38d361c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:35.763494 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753c656-03b0-4005-8811-8b38d361c423 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.763835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753c656-03b0-4005-8811-8b38d361c423 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.764112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753c656-03b0-4005-8811-8b38d361c423 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.764766 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753c656-03b0-4005-8811-8b38d361c423 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:35.766330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753c656-03b0-4005-8811-8b38d361c423 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:35.801536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 15/33] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Aug 22 13:56:35 2022] POST /identity/v3/roles => generated 225 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:35.802569 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:35.910557 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 19/34] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:56:35 2022] POST /identity/v3/projects => generated 301 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:35.912088 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c709a7-f5c0-4589-a7fa-2acf8954fa3f None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:35.912471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c709a7-f5c0-4589-a7fa-2acf8954fa3f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:35.912845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c709a7-f5c0-4589-a7fa-2acf8954fa3f None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:35.914405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 20/35] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:35.915339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c709a7-f5c0-4589-a7fa-2acf8954fa3f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:35.932548 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a1af0-3c36-4e11-84e5-8858b128579e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.004834 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.005588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.005939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.006278 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.007123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:36.007502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.009261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953b027-f3f0-4b63-9364-0114c76373c6 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.024202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 16/36] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:36.026721 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.027008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.027360 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.047346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:36.049570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:36.070385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:36.122988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c709a7-f5c0-4589-a7fa-2acf8954fa3f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.124971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:36.144910 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 17/37] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:36.145605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:36.167622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecc436-4dc0-4886-9e71-9ad29e054ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.168352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc436-4dc0-4886-9e71-9ad29e054ab6 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.168631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc436-4dc0-4886-9e71-9ad29e054ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.168907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc436-4dc0-4886-9e71-9ad29e054ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.169792 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecc436-4dc0-4886-9e71-9ad29e054ab6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.171477 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecc436-4dc0-4886-9e71-9ad29e054ab6 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.192912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 21/38] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Aug 22 13:56:35 2022] POST /identity/v3/roles => generated 219 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:36.207132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25927f-1d80-4d36-a4d6-6071b0deeac0 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.207443 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25927f-1d80-4d36-a4d6-6071b0deeac0 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.207683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25927f-1d80-4d36-a4d6-6071b0deeac0 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.209021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 22/39] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:36.218073 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.218819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.219099 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.248235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:36.250242 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:36.269619 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f8d6b-78b9-46f3-b331-26abaf409a16 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.313013 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.313763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.314044 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.314534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.316421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.318000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.320050 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 18/40] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:36 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:36.326546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:36.341433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 23/41] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:36.392524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:36.467289 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55884-f4da-4d81-bea8-e3ff1c9452cd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.506121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.506776 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.507058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.507334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.508476 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.509960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.511558 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 19/42] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:36.522446 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:36.548185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:36.659302 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:36.665563 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:36.674221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae11a-e70f-487c-a42f-bf7bef95d182 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.675732 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f4663-9410-476f-b752-1df06532a9d6 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.711804 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.712423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.712703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.712877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.712982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.713524 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.713683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.713839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.714089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] PATH_INFO: `/v3/domains/default/users/8875dd4e092c4727887ccb9579eeb3e4/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.715055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.716000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8875dd4e092c4727887ccb9579eeb3e4, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.717492 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.730522 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 20/43] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Aug 22 13:56:36 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:36.736048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 24/44] 10.222.0.40 () {58 vars in 1361 bytes} [Mon Aug 22 13:56:36 2022] PUT /identity/v3/domains/default/users/8875dd4e092c4727887ccb9579eeb3e4/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:56:36.751951 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:36.876107 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e929a-7712-455b-9f15-204edc22a7ac None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:36.919498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded62c7-dcf3-47cc-89fe-a078399e90e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:36.920176 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded62c7-dcf3-47cc-89fe-a078399e90e2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:36.920460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded62c7-dcf3-47cc-89fe-a078399e90e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:36.920739 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded62c7-dcf3-47cc-89fe-a078399e90e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:36.921980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded62c7-dcf3-47cc-89fe-a078399e90e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:36.923623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded62c7-dcf3-47cc-89fe-a078399e90e2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:36.925695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 21/45] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:36.931917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:37.039005 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c3fdb-7cd9-4039-a006-2035362031c0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:37.073710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe117c-25a9-452d-b32d-865d1d2f72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:37.074326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe117c-25a9-452d-b32d-865d1d2f72ce None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:37.074610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe117c-25a9-452d-b32d-865d1d2f72ce None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:37.074882 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe117c-25a9-452d-b32d-865d1d2f72ce None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:37.075523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe117c-25a9-452d-b32d-865d1d2f72ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:37.076990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe117c-25a9-452d-b32d-865d1d2f72ce None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:37.105937 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 25/46] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:56:36 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:38.938643 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c43b9-c2c6-4e57-9a39-89f3d94e5484 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:38.939258 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c43b9-c2c6-4e57-9a39-89f3d94e5484 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:38.939258 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c43b9-c2c6-4e57-9a39-89f3d94e5484 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:38.940608 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 22/47] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:38.946189 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5340982-efc6-4586-80dc-2905e4e54f26 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:38.946621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5340982-efc6-4586-80dc-2905e4e54f26 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:38.946775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5340982-efc6-4586-80dc-2905e4e54f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:38.954746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:38.966544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-e5340982-efc6-4586-80dc-2905e4e54f26 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:38.967744 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-e5340982-efc6-4586-80dc-2905e4e54f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:39.037319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:39.263328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365546b-c0b0-4ed5-a9e4-4852a7e609c2 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.263517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365546b-c0b0-4ed5-a9e4-4852a7e609c2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.263799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365546b-c0b0-4ed5-a9e4-4852a7e609c2 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.265386 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 23/49] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:39.271010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.271294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.271567 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.290602 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:39.291793 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:39.356235 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365546b-c0b0-4ed5-a9e4-4852a7e609c2 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:39.362644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 27/50] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:39.375578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:39.468557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365546b-c0b0-4ed5-a9e4-4852a7e609c2 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:39.506111 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:39.506958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.507374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.507778 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.522497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:39.528313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:39.529134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:56:39.530054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 24/51] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:56:39.535625 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:39.598619 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:39.640205 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373b46-e53d-4e10-bb30-04f698e7a605 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:39.680155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:39.680819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.681127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.681471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.682166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:39.682467 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:39.683854 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:39.692213 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 28/52] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:39.697930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:39.713410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:39.777726 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:39.801545 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bda7e-f067-42ac-9fea-dad2d07d9187 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:39.828047 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ae1cb-7329-418a-b6b3-eab520d4aee1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:39.839944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:39.840587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.840896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.841165 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.842396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:39.843871 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:39.845545 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 25/53] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:39 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:39.851217 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:39.853752 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:39.863733 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:39.864375 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.864658 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.864960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.866137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:39.867615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:39.872665 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 29/54] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:39.874600 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:39.951709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e274c4-a062-4a03-af43-cbcb3d9aed11 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:39.974408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfa56e-c237-4ca6-a4f5-6b8c602e4354 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:39.985640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:39.986334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:39.986613 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:39.986882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:39.988011 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:39.989497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:39.991256 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 26/55] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:39.997113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:40.010418 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472380a1-dfa1-4d4c-8513-ebdf0135bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:40.011051 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472380a1-dfa1-4d4c-8513-ebdf0135bda2 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:40.011338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472380a1-dfa1-4d4c-8513-ebdf0135bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:40.011617 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472380a1-dfa1-4d4c-8513-ebdf0135bda2 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:40.012287 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472380a1-dfa1-4d4c-8513-ebdf0135bda2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:40.012858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:40.013833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472380a1-dfa1-4d4c-8513-ebdf0135bda2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:40.042313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 30/56] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Aug 22 13:56:39 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:56:40.104919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29620-2986-426b-993d-8951cf4f9834 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:40.143451 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:40.144073 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:40.144350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:40.144621 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:40.145389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.domain.id=default, user.id=8875dd4e092c4727887ccb9579eeb3e4) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:40.145695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:40.147163 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0268-4b68-48a8-9f68-79bedb869ec2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:40.157363 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 27/57] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Aug 22 13:56:39 2022] GET /identity/v3/role_assignments?user.id=8875dd4e092c4727887ccb9579eeb3e4&scope.domain.id=default&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:42.244451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece81eb-3bae-487d-b0e9-6d7bd783cd88 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:42.244980 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece81eb-3bae-487d-b0e9-6d7bd783cd88 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:42.244980 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece81eb-3bae-487d-b0e9-6d7bd783cd88 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:42.247250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 31/58] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:42.254809 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:42.255299 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:42.255385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:42.278651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:42.279868 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:42.354712 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 28/59] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:42.707026 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece81eb-3bae-487d-b0e9-6d7bd783cd88 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:42.764994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:42.822021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece81eb-3bae-487d-b0e9-6d7bd783cd88 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:42.857108 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1606965-3ba6-4fb3-a028-200938132bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:42.857773 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1606965-3ba6-4fb3-a028-200938132bf6 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:42.858054 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1606965-3ba6-4fb3-a028-200938132bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:42.858320 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1606965-3ba6-4fb3-a028-200938132bf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:42.859451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1606965-3ba6-4fb3-a028-200938132bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:42.860978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1606965-3ba6-4fb3-a028-200938132bf6 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:42.862580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 32/60] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:42.871161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:42.886236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:42.994995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c0a8f-abe3-4e2a-ad31-3f998fb58d86 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:43.036217 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8654042-1599-4236-af19-aa57d64c5ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:43.037317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8654042-1599-4236-af19-aa57d64c5ed2 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:43.037632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8654042-1599-4236-af19-aa57d64c5ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:43.037898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8654042-1599-4236-af19-aa57d64c5ed2 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:43.038568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8654042-1599-4236-af19-aa57d64c5ed2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:43.040049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8654042-1599-4236-af19-aa57d64c5ed2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:43.071939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 29/61] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:56:42 2022] POST /identity/v3/users => generated 275 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:46.472337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3f70-6beb-473f-af8d-5c9ce10ea3a0 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:46.473215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3f70-6beb-473f-af8d-5c9ce10ea3a0 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:46.473628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3f70-6beb-473f-af8d-5c9ce10ea3a0 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:46.475421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 33/62] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:46.480640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b1a6-b58f-4e0b-80a8-d4532b13466c None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:46.481436 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b1a6-b58f-4e0b-80a8-d4532b13466c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:46.481851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b1a6-b58f-4e0b-80a8-d4532b13466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:46.510552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-7e32b1a6-b58f-4e0b-80a8-d4532b13466c None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:46.511818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-7e32b1a6-b58f-4e0b-80a8-d4532b13466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:46.603043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:46.616383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 30/63] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:46.689413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317364f-6c37-41a7-ae55-a64f6cb8232d None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:46.690039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317364f-6c37-41a7-ae55-a64f6cb8232d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:46.690582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317364f-6c37-41a7-ae55-a64f6cb8232d None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:46.692130 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 34/64] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:46.697575 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4bdc-2aee-41ca-8bef-0eb925564ee1 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:46.697868 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4bdc-2aee-41ca-8bef-0eb925564ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:46.698149 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4bdc-2aee-41ca-8bef-0eb925564ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:46.722540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-938b4bdc-2aee-41ca-8bef-0eb925564ee1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:46.723859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-938b4bdc-2aee-41ca-8bef-0eb925564ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:46.819954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 31/65] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:46.893234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325db9e-7e3c-4df0-bc5f-68539d81f46b None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:46.893234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325db9e-7e3c-4df0-bc5f-68539d81f46b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:46.893234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325db9e-7e3c-4df0-bc5f-68539d81f46b None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:46.894081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 35/66] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:46.899759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942bded-8c5f-4a37-9a1c-c10eb53fd2f2 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:46.900054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942bded-8c5f-4a37-9a1c-c10eb53fd2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:46.900328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942bded-8c5f-4a37-9a1c-c10eb53fd2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:46.925415 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a942bded-8c5f-4a37-9a1c-c10eb53fd2f2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:46.926690 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a942bded-8c5f-4a37-9a1c-c10eb53fd2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:47.006843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 32/67] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:47.155236 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325db9e-7e3c-4df0-bc5f-68539d81f46b None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.184877 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3163a-7fe1-46e8-95f2-40cccfd0645a None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.185449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3163a-7fe1-46e8-95f2-40cccfd0645a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.185902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3163a-7fe1-46e8-95f2-40cccfd0645a None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.187412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 33/68] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:56:47.192566 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.193036 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.193505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.219979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:47.221607 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:47.271494 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325db9e-7e3c-4df0-bc5f-68539d81f46b None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.281442 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:47.292709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:47.308007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 34/69] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:56:47.309542 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.331967 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715b69-bfbc-42ac-822e-dd8218e3ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.332987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715b69-bfbc-42ac-822e-dd8218e3ed85 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.333442 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715b69-bfbc-42ac-822e-dd8218e3ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.333877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715b69-bfbc-42ac-822e-dd8218e3ed85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.345098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc715b69-bfbc-42ac-822e-dd8218e3ed85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-dc715b69-bfbc-42ac-822e-dd8218e3ed85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:47.350396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:47.351425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:47.352389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:47.359233 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 36/70] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:47.361135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d03dd-27df-47f7-b085-3884e0c95f71 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.361593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d03dd-27df-47f7-b085-3884e0c95f71 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.362162 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d03dd-27df-47f7-b085-3884e0c95f71 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.363624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 37/71] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:47.364610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d03dd-27df-47f7-b085-3884e0c95f71 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.440057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d440b-a8c7-43c1-9efb-647bbac78a29 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.477343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db671a3-58f2-4dd4-bf4d-377428411567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.478007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db671a3-58f2-4dd4-bf4d-377428411567 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.478287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db671a3-58f2-4dd4-bf4d-377428411567 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.478559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db671a3-58f2-4dd4-bf4d-377428411567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.485463 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d03dd-27df-47f7-b085-3884e0c95f71 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.489999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db671a3-58f2-4dd4-bf4d-377428411567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-8db671a3-58f2-4dd4-bf4d-377428411567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:47.494826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:47.495645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:56:47.496578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 35/72] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:47.497760 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.497926 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.498202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.518835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:47.520135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:47.527293 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.527804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.528135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.528357 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.529148 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:47.529489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:47.531129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:47.540357 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 38/73] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:47.541289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.581219 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:47.599688 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:47.612463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 36/74] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:47.613534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.686189 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b7ae5-a6ce-48cb-8b73-4f76f95a35ef None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.722145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00119-92e5-4acf-9b25-136caf4c4bf5 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.724391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.725054 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.725369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.725642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.736484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:47.741702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:47.742547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:47.743311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 39/75] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:47.743935 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.761984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.762895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.763371 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.763811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.764649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:47.765094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:47.766690 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:47.776084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 37/76] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:47.776978 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.818689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:47.852245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:47.859012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a1ae7-5752-433c-b05f-171882a07d4b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.901994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6ed06-ad7b-43fc-a6a3-96bf792fc5a6 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:47.907832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.908484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.908829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.909201 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.925582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:47.927013 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:47.928864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 40/77] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:47.934314 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:47.955489 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:47.956169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:47.956457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:47.956736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:47.969126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:47.975016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:47.975913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:56:47.976650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 38/78] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:47.977387 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.065594 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc49da-2307-4fc4-a02f-e4e42cd9eeb9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.073428 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.081533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b294-87a2-4c6e-90d3-856d2b243db6 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.102624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.103245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.103527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.103804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.104471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:48.104775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.106227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.115305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 41/79] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:48.116274 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.117704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.118347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.118636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.119081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.121159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.122697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.124257 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 39/80] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:47 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:48.126180 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.141815 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.227062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947667-3c75-4850-a5e5-77c687c11956 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.239137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993188c7-c230-4886-b26c-0297cf812d4a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.264450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.265044 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.265352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.265623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.277741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.278393 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.278677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.278950 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.280116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.281694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.283269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 40/81] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:48.284062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.317058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.339807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.341241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.359871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.394770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad121f0-8498-4990-9d63-7fb87c814ab2 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.437058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.438101 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.438556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.439051 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.440227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:48.440558 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.442013 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.453270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 41/82] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:48.454554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.469854 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 42/83] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:56:48.471295 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.584839 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.592353 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2242-8e2d-46eb-bb8c-46a9e24d1ccc None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.610214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e637349-8c58-47f8-9164-451dfbe3544f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.626791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.627651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.628311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.628585 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.628863 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.630074 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.631540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.633126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 42/84] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:48.633890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.650621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.651258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.651541 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.651809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.723318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.724821 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.749983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810746-9861-4ed0-b48f-b3e711d41c38 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:48.794445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:48.795182 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:48.795458 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:48.795790 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:48.796367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:48.797910 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:48.821136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 43/85] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:56:48 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:48.822027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.854659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.890170 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 43/86] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:56:48.890170 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:48.916940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:48.979033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1943-9ffb-488d-b791-1a73a1e3b93e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:49.020110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:49.020823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:49.021113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:49.021454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:49.022630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:49.024096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:49.025738 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 44/87] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:49.026517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:49.032290 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d65fd-98b9-4fc5-9b11-b811ef5d88c8 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:49.083802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:49.084388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:49.084684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:49.084952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:49.086203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:49.088536 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:49.091735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 44/88] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:48 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:49.091735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:49.176971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:49.198999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2cd03-97f7-445c-b271-1bfcf0a06587 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:49.224172 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:49.250352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d45b-b5b2-4e3d-a20a-3ca80229617e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:49.251538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:49.252326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:49.252818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:49.254226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:49.315107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:49.316199 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:49.316700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:49.317406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:49.319487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:49.322499 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:49.325978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 45/89] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:49 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:49.327338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:49.370139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:49.372651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:49.488189 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:49.490352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a55bb-150a-4209-9682-1b6b9f2e98af None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:49.519280 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 45/90] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:56:49.520869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:49.562590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:49.563232 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:49.563513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:49.563790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:49.594898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:49.654197 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095e90-eca1-4ba3-885b-c26f9a4ac9a3 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:49.679619 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:49.682260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:49.715216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:49.716744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:49.717429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:49.717925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:49.718906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=03d11c48f9b14945aa9338b717dc969b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:49.719479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:49.721345 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:49.731423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 46/91] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:56:49 2022] GET /identity/v3/role_assignments?user.id=03d11c48f9b14945aa9338b717dc969b&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:49.732725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:49.810091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:49.841376 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 46/92] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:56:49.842368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:49.921077 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:49.992410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2863c5-42f1-4518-a695-29c0e4692b67 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:50.009224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289919c1-f1bc-4db4-8629-8c5227f44ccb None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:50.078025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:50.078605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:50.078925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:50.079222 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:50.080027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=8875dd4e092c4727887ccb9579eeb3e4) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:50.080347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:50.081891 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:50.089240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:50.089509 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 47/93] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:56:49 2022] GET /identity/v3/role_assignments?user.id=8875dd4e092c4727887ccb9579eeb3e4&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:50.090282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:50.090697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:50.090846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:50.091346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:50.093477 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:50.096919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:50.101873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 47/94] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:49 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:50.118462 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:50.314458 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe116d-6770-48f1-84d0-e391ad8ed5b8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:50.338064 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e919a2-d639-4c82-acf5-22bfb0d947b2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:50.344803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:50.397440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:50.398112 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:50.398391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:50.398663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] PATH_INFO: `/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:50.400852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] RBAC: Authorizing `identity:get_project(project_id=27cbeb3191e44e0aba37dfaa4db812ce)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:50.402547 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:50.404221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 48/95] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:50 2022] GET /identity/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce => generated 312 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:50.411539 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:50.411869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:50.455847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:50.455847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:50.455847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:50.455847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:50.456264 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] RBAC: Adding query filter params (role.id=df09061e3469445199489ef690728a10, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=03d11c48f9b14945aa9338b717dc969b) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:50.456264 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:50.456384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdb871-930b-4296-acdd-9e1a6edaf617 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:50.476561 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 48/96] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:56:50 2022] GET /identity/v3/role_assignments?user.id=03d11c48f9b14945aa9338b717dc969b&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=df09061e3469445199489ef690728a10 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:50.609247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ff59c-9b87-4fdf-945d-916b2d4b96dd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:50.667614 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:50.668705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:50.669204 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:50.670202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:50.671124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=27cbeb3191e44e0aba37dfaa4db812ce, user.id=03d11c48f9b14945aa9338b717dc969b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:50.671675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:50.675095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a229e-d3e6-45d3-8610-d844f0fe27b3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:50.684326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 49/97] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:56:50 2022] GET /identity/v3/role_assignments?user.id=03d11c48f9b14945aa9338b717dc969b&scope.project.id=27cbeb3191e44e0aba37dfaa4db812ce&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:51.746797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a67b-43cb-4375-8172-51e3241c6646 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:51.747317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a67b-43cb-4375-8172-51e3241c6646 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:51.747825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a67b-43cb-4375-8172-51e3241c6646 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:51.750460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 49/98] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:51.757615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9017d3-936f-430b-ade5-705aae7f1293 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:51.758137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9017d3-936f-430b-ade5-705aae7f1293 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:51.758137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9017d3-936f-430b-ade5-705aae7f1293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:51.778577 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-6f9017d3-936f-430b-ade5-705aae7f1293 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:51.779863 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-6f9017d3-936f-430b-ade5-705aae7f1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:51.839644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:51.872274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 50/99] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:52.154776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde490e-29a5-4b0a-ac16-250f88c253e3 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:52.155067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde490e-29a5-4b0a-ac16-250f88c253e3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:52.155282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde490e-29a5-4b0a-ac16-250f88c253e3 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:52.156769 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 50/100] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:52.162215 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:52.162501 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:52.162777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:52.181438 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:52.182622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:52.263413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 51/101] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:52.541476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde490e-29a5-4b0a-ac16-250f88c253e3 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:52.686719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde490e-29a5-4b0a-ac16-250f88c253e3 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:52.722858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:52.723879 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:52.724386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:52.724851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:52.736373 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:52.741894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:52.742731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:56:52.743572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:52.745923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 51/102] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:52.754646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:52.886483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:52.909250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358856a9-9e1a-4411-864f-817e0b84e018 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:52.918081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:52.971666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:52.985988 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:52.986903 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:52.987316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:52.987721 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:52.988534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:52.989002 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:52.990691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:53.004899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 52/103] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:56:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:53.010764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:53.080393 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60ec2-8102-4ad5-96f4-31c292aa2333 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:53.162925 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:53.163939 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.164312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.164679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.168002 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:53.169674 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:53.171531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 52/104] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:53.179040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:53.279294 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cf38-dde6-4a0c-9295-9c3cf2c0d2d9 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:53.335959 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5545b-a1d6-4887-8f4e-50e1f0e8f812 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:53.353604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:53.373000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:53.373682 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.374125 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.374406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.375061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:53.376574 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:53.417843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc331d-2a71-43e5-9401-fefc3ad3d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:53.418457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc331d-2a71-43e5-9401-fefc3ad3d00e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.418911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc331d-2a71-43e5-9401-fefc3ad3d00e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.419382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 53/105] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:56:53 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:56:53.420251 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc331d-2a71-43e5-9401-fefc3ad3d00e None admin] PATH_INFO: `/v3/users/5d47d6f3a56f40f8b510eb2f710cdaad` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.457757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc331d-2a71-43e5-9401-fefc3ad3d00e None admin] RBAC: Authorizing `identity:get_user(user_id=5d47d6f3a56f40f8b510eb2f710cdaad)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:53.459316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc331d-2a71-43e5-9401-fefc3ad3d00e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:53.461457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 53/106] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:53 2022] GET /identity/v3/users/5d47d6f3a56f40f8b510eb2f710cdaad => generated 289 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:53.467348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:53.542782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea6ce-35fc-4245-af2d-239a375de31f None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.543401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea6ce-35fc-4245-af2d-239a375de31f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.543861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea6ce-35fc-4245-af2d-239a375de31f None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.545515 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 54/107] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:53.563760 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901308af-37f3-4151-8b3f-9ba29718244b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.564388 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901308af-37f3-4151-8b3f-9ba29718244b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.564896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901308af-37f3-4151-8b3f-9ba29718244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.591352 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-901308af-37f3-4151-8b3f-9ba29718244b None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:53.594460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-901308af-37f3-4151-8b3f-9ba29718244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:53.657699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:53.705116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80a3a-7264-4330-b56c-7546262c8dda None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:53.736227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 55/108] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:56:53.750852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5614576-0f3b-411d-8d36-a52b64f1721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:53.751809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5614576-0f3b-411d-8d36-a52b64f1721f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.752308 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5614576-0f3b-411d-8d36-a52b64f1721f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.752828 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5614576-0f3b-411d-8d36-a52b64f1721f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.792926 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:53.845523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5614576-0f3b-411d-8d36-a52b64f1721f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:53.848701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5614576-0f3b-411d-8d36-a52b64f1721f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:53.973031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42199e-10e0-4d61-9e82-409c821151f5 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.973570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42199e-10e0-4d61-9e82-409c821151f5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.973570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42199e-10e0-4d61-9e82-409c821151f5 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.975008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 56/109] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:56:53.976009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 54/110] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:56:53.982215 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fb5ea-38bf-440f-b94e-0ed76111ab4f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.982499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fb5ea-38bf-440f-b94e-0ed76111ab4f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.982780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fb5ea-38bf-440f-b94e-0ed76111ab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.986046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92188d1f-02e1-4490-819d-84b81cf0a1ee None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:53.986046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92188d1f-02e1-4490-819d-84b81cf0a1ee None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:53.986046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92188d1f-02e1-4490-819d-84b81cf0a1ee None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:53.987271 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 55/111] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:56:53.987986 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92188d1f-02e1-4490-819d-84b81cf0a1ee None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.015822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-821fb5ea-38bf-440f-b94e-0ed76111ab4f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:54.017116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-821fb5ea-38bf-440f-b94e-0ed76111ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:54.067587 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:54.113071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92188d1f-02e1-4490-819d-84b81cf0a1ee None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.145119 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 57/112] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:54.150885 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23edf6d-498d-4933-886c-c6a682c900d7 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.152833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23edf6d-498d-4933-886c-c6a682c900d7 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.152833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23edf6d-498d-4933-886c-c6a682c900d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.168449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929961-1924-4dce-981c-dae1283f9f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:54.170187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929961-1924-4dce-981c-dae1283f9f1c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.170523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929961-1924-4dce-981c-dae1283f9f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.170802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929961-1924-4dce-981c-dae1283f9f1c None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.174425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929961-1924-4dce-981c-dae1283f9f1c None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:54.177990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929961-1924-4dce-981c-dae1283f9f1c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:54.182596 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 56/113] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:53 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:54.183863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9101-9d0b-496f-a2c0-099f276b8a6d None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.184145 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9101-9d0b-496f-a2c0-099f276b8a6d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.187842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9101-9d0b-496f-a2c0-099f276b8a6d None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.189152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 57/114] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:54.189907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9101-9d0b-496f-a2c0-099f276b8a6d None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.193921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c23edf6d-498d-4933-886c-c6a682c900d7 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:54.195442 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c23edf6d-498d-4933-886c-c6a682c900d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:54.282843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 58/115] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:54.284564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.285040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.285497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.304416 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:54.305933 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:54.317560 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9101-9d0b-496f-a2c0-099f276b8a6d None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.318264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:54.349902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:54.355797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:54.356589 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.357008 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.357450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.358345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] RBAC: Adding query filter params (role.id=888d00d671c64fa8aed78ff50a5f2f0c, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=5d47d6f3a56f40f8b510eb2f710cdaad) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:54.358835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:54.360990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:54.367852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 58/116] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/role_assignments?user.id=5d47d6f3a56f40f8b510eb2f710cdaad&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=888d00d671c64fa8aed78ff50a5f2f0c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:54.368847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.391697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 59/117] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:54.492184 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107ca3-a3e9-4316-a10a-5cc57197628b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.532364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:54.533450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.534041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.534549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.549837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:54.555641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:54.556573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:54.557364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:54.559474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 59/118] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:54.565830 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.662401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.686089 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff324035-b9d5-4f99-8ab5-fa7ce2c4c4d8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.721133 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:54.721792 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.722070 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.722340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.723010 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:54.723307 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:54.724695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:54.731353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:54.733871 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 60/119] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:54.740133 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.752205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:54.783163 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26144d9-eb25-4223-9fa1-c83722d7365d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.821060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:54.822091 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.822614 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.823081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.834916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:54.840979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:54.841974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:56:54.842916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:54.845592 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 60/120] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:54.849278 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c94b16-5bb6-4044-970b-d0a67c158b95 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.850616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.885887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:54.886627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:54.886974 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:54.887366 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:54.888497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:54.890065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:54.896417 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 61/121] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:54.897459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:54.965762 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab16c0-195f-4404-8ea9-1c436d734cd8 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:54.976905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:54.985623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:55.001037 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812309b-3106-404e-9491-a772e7636bb0 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.009132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.010067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.010532 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.011115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.024666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:55.030092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:55.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:56:55.031788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:55.034415 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 61/122] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:55.035509 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.037467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.038162 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.038511 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.038867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.039953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:55.040062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.041911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.051046 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 62/123] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.052151 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.152423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563911e1-ab20-4049-8066-ec1b479aca23 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.182519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdca7c-d8ae-4701-98f0-f28b047aec07 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.199728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.200670 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.201409 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.202250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.203582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.205926 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.208302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 62/124] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.209344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.225166 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.225969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.226313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.226652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.227382 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:55.227752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.229367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.235557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:55.241012 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 63/125] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.242039 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.290540 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:55.354372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15aa8-3b3f-4919-842c-3994fb0220e0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.367224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df24e-3144-4422-bb6f-d52771e33c37 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.397530 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.398691 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.399124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.399679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.408611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.409351 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.409973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.410345 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.411805 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.412638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:55.413723 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.415457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 64/126] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.420196 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:55.420333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:55.421127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:56:55.421917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:56:55.424239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 63/127] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:55.426153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.503960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:55.540559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6f1c-95ba-48a6-a819-fccf733ed302 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.566055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393855a-1ce7-4e6e-898d-afea46a41887 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.570313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:55.593935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.594619 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.594898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.595175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/03d11c48f9b14945aa9338b717dc969b/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.597930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] RBAC: Authorizing `identity:create_grant(project_id=072d9903a785453d86ed0052ef7c3e12, user_id=03d11c48f9b14945aa9338b717dc969b, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.600106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.608014 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.608936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.609353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.609742 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.611133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.612877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.615168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 64/128] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.615870 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.621456 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 65/129] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:56:55 2022] PUT /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/03d11c48f9b14945aa9338b717dc969b/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:56:55.627652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.815346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a175d-6b70-404f-97de-820d11ba3e8a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.848213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7cbd-1538-407d-8565-cf7cee6cf0dd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:55.883755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.884948 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.885307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.885847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.887132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.889208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.891096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:55.891640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 65/130] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.893000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.907132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:55.907811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:55.908099 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:55.908374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:55.909157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:55.909573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:55.911122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:55.922599 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 66/131] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:55.923798 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:55.953755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:56.021782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea2e2-8e35-4f88-8d56-5ce88adf3194 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:56.056718 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cc0ad-dcf7-4602-95c9-3b5b9e40045d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:56.075299 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:56.076564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.076849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.077371 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.079898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:56.081698 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:56.083353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 66/132] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:55 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:56.084201 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:56.110075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:56.110764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.111053 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.111330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/03d11c48f9b14945aa9338b717dc969b/roles/df09061e3469445199489ef690728a10` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.118248 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] RBAC: Authorizing `identity:create_grant(project_id=072d9903a785453d86ed0052ef7c3e12, user_id=03d11c48f9b14945aa9338b717dc969b, role_id=df09061e3469445199489ef690728a10)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:56.119740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:56.148909 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 67/133] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:56:55 2022] PUT /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/03d11c48f9b14945aa9338b717dc969b/roles/df09061e3469445199489ef690728a10 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:56:56.149560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:56.218022 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:56.245727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f57062-a796-4107-b585-f7a392c9ac8e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:56.256360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:56.289151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:56.289858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.293212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.293212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.293212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:56.293212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:56.297208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 67/134] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:56 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:56.310305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:56.313544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24664402-b43a-4ee7-a5a3-e9e9a886e432 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:56.364908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740e2f-c2ff-47bc-98a2-5f87f9b1667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:56.365547 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740e2f-c2ff-47bc-98a2-5f87f9b1667f None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.365827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740e2f-c2ff-47bc-98a2-5f87f9b1667f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.366108 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740e2f-c2ff-47bc-98a2-5f87f9b1667f None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/8875dd4e092c4727887ccb9579eeb3e4/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.370758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b740e2f-c2ff-47bc-98a2-5f87f9b1667f None admin] RBAC: Authorizing `identity:create_grant(project_id=072d9903a785453d86ed0052ef7c3e12, user_id=8875dd4e092c4727887ccb9579eeb3e4, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:56.379279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b740e2f-c2ff-47bc-98a2-5f87f9b1667f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:56.412098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 68/135] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:56:56 2022] PUT /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/8875dd4e092c4727887ccb9579eeb3e4/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:56:56.506011 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37bc2-83bd-4b4e-8797-1494ba44fc25 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:56.539971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d027-2ad7-48b5-973b-3c21a047ae63 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.540621 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d027-2ad7-48b5-973b-3c21a047ae63 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.541091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d027-2ad7-48b5-973b-3c21a047ae63 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.542693 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 69/136] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:56.558289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:56.559570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.559898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.560172 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] PATH_INFO: `/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.563224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] RBAC: Authorizing `identity:get_project(project_id=27cbeb3191e44e0aba37dfaa4db812ce)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:56.564084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cc154-728c-4514-84ed-ccf82b9bbd11 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.564717 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cc154-728c-4514-84ed-ccf82b9bbd11 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.564893 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:56.567526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cc154-728c-4514-84ed-ccf82b9bbd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.571983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 68/137] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:56 2022] GET /identity/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:56.577714 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:56.593931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-4f1cc154-728c-4514-84ed-ccf82b9bbd11 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:56.595532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-4f1cc154-728c-4514-84ed-ccf82b9bbd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:56.669625 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:56.698564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 70/138] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:56.772069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4539-ab89-478d-9391-d048f7354821 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:56.809598 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf0fe1-80d6-40d4-9381-a9a1cdaf197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:56.810275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf0fe1-80d6-40d4-9381-a9a1cdaf197a None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:56.810555 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf0fe1-80d6-40d4-9381-a9a1cdaf197a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:56.810828 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf0fe1-80d6-40d4-9381-a9a1cdaf197a None admin] PATH_INFO: `/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce/users/03d11c48f9b14945aa9338b717dc969b/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:56.813919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf0fe1-80d6-40d4-9381-a9a1cdaf197a None admin] RBAC: Authorizing `identity:create_grant(project_id=27cbeb3191e44e0aba37dfaa4db812ce, user_id=03d11c48f9b14945aa9338b717dc969b, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:56.815534 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf0fe1-80d6-40d4-9381-a9a1cdaf197a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:56.840037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 69/139] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:56:56 2022] PUT /identity/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce/users/03d11c48f9b14945aa9338b717dc969b/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:56:57.180707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced303e2-7054-435f-879c-f612dc7f10bb None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:57.181771 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced303e2-7054-435f-879c-f612dc7f10bb None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:57.182294 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced303e2-7054-435f-879c-f612dc7f10bb None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:57.183902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 71/140] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:57.189462 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:57.189968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:57.190148 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:57.217797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:57.219058 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:57.256104 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced303e2-7054-435f-879c-f612dc7f10bb None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:57.320548 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:57.326500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 70/141] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:57.385836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced303e2-7054-435f-879c-f612dc7f10bb None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:57.426816 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:57.427504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:57.427781 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:57.428053 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:57.429213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:57.430850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:57.432413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 72/142] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:56:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:57.438007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:57.493571 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:57.585139 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2990-c15d-494c-b29c-71864f6fc618 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:57.638124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:57.638753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:57.639032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:57.639299 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:57.639952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:57.641432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:57.695295 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 71/143] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:56:57 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:56:57.946886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:58.075246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf17c-900a-4be9-8d46-aaef1003062c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:58.090356 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:58.118840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:58.119503 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:58.119792 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:58.120060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:58.132919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:56:58.137655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:56:58.138504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:56:58.139460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 73/144] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:56:58.146358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:58.267927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:58.278661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743f15e-a482-438e-99f0-6085b1c1b9d9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:58.318990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:58.319610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:58.319898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:58.320163 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:58.320823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:56:58.321119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:58.322533 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:58.336559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 72/145] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:56:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:56:58.341896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:58.449897 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70d28e-f9b2-43fd-ad02-ee9badf63d7c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:58.487229 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:58.487913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:58.488191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:58.488457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] PATH_INFO: `/v3/users/5d47d6f3a56f40f8b510eb2f710cdaad` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:58.491348 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] RBAC: Authorizing `identity:get_user(user_id=5d47d6f3a56f40f8b510eb2f710cdaad)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:58.492889 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:58.494732 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 74/146] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:56:58 2022] GET /identity/v3/users/5d47d6f3a56f40f8b510eb2f710cdaad => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:58.500210 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:58.636520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2292-022d-497c-ba70-b57c27e2bcbe None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:58.679244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87b64a-86ad-40df-962d-a5fc5b363792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:58.679940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b64a-86ad-40df-962d-a5fc5b363792 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:58.680220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b64a-86ad-40df-962d-a5fc5b363792 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:58.680491 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b64a-86ad-40df-962d-a5fc5b363792 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:58.681696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87b64a-86ad-40df-962d-a5fc5b363792 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:58.683158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87b64a-86ad-40df-962d-a5fc5b363792 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:58.684791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 73/147] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:56:58 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:56:58.691005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:58.730343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:58.813175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d358658-d764-434a-afb3-c1ee24c40e93 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:56:58.856594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171f96-6818-4693-ba3c-551ee0b810ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:56:58.857323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171f96-6818-4693-ba3c-551ee0b810ad None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:58.857607 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171f96-6818-4693-ba3c-551ee0b810ad None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:58.857879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171f96-6818-4693-ba3c-551ee0b810ad None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/5d47d6f3a56f40f8b510eb2f710cdaad/roles/888d00d671c64fa8aed78ff50a5f2f0c` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:58.859900 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171f96-6818-4693-ba3c-551ee0b810ad None admin] RBAC: Authorizing `identity:create_grant(project_id=072d9903a785453d86ed0052ef7c3e12, user_id=5d47d6f3a56f40f8b510eb2f710cdaad, role_id=888d00d671c64fa8aed78ff50a5f2f0c)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:56:58.861434 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171f96-6818-4693-ba3c-551ee0b810ad None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:56:58.876759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 75/148] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:56:58 2022] PUT /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12/users/5d47d6f3a56f40f8b510eb2f710cdaad/roles/888d00d671c64fa8aed78ff50a5f2f0c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:56:59.049738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606aad1-561c-4cef-9f71-2e046c460231 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:59.050273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606aad1-561c-4cef-9f71-2e046c460231 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:59.050676 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606aad1-561c-4cef-9f71-2e046c460231 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:59.052395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 74/149] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:59.063114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1663bd1-343b-4afb-aa9b-145e944027d8 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:59.063757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1663bd1-343b-4afb-aa9b-145e944027d8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:59.064218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1663bd1-343b-4afb-aa9b-145e944027d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:59.084914 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-e1663bd1-343b-4afb-aa9b-145e944027d8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:59.086469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-e1663bd1-343b-4afb-aa9b-145e944027d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:59.176759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 76/150] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:59.562830 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2d87a-75a7-4a04-8121-d2875fc10b26 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:59.563657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2d87a-75a7-4a04-8121-d2875fc10b26 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:59.564078 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2d87a-75a7-4a04-8121-d2875fc10b26 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:59.565756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 75/151] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:56:59.571406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:56:59.571846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:56:59.571940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:56:59.598516 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:56:59.599726 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:56:59.625069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:56:59.691815 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 77/152] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:56:59.900476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2d87a-75a7-4a04-8121-d2875fc10b26 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:56:59.924704 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:00.054283 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2d87a-75a7-4a04-8121-d2875fc10b26 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:00.099615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:00.100252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.100528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.100859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.114764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:00.119927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:00.120796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:00.122098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 76/153] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:56:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:00.127799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:00.223629 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:00.293410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db1f7-8e22-4cb0-9bd6-d133d874e192 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:00.356773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:00.357417 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.357690 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.357964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.358629 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:00.358927 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:00.360318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:00.369623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:00.375772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 78/154] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:00.386315 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:00.410606 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693ccc-35b6-43b6-9560-67f12266fc57 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:00.422045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:00.479179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:00.480003 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.480283 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.480554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.498908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:00.508861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:00.509802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:00.511204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 77/155] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:00.524860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:00.587099 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811b27-106c-4d85-ab96-f7674df08caf None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:00.656355 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de372-20f1-4d0b-9397-397aaa86950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:00.657153 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de372-20f1-4d0b-9397-397aaa86950d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.657540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de372-20f1-4d0b-9397-397aaa86950d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.657852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de372-20f1-4d0b-9397-397aaa86950d None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.659425 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6de372-20f1-4d0b-9397-397aaa86950d None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:00.660932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6de372-20f1-4d0b-9397-397aaa86950d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:00.663847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 79/156] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:00 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:00.665209 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149b32-fd1d-452c-a7d5-078b798bf202 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.665474 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149b32-fd1d-452c-a7d5-078b798bf202 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.665822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149b32-fd1d-452c-a7d5-078b798bf202 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.667377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 80/157] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:00.674053 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149b32-fd1d-452c-a7d5-078b798bf202 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:00.710908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22fee-46fb-4b3a-936e-4173ace1e00f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:00.774073 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:00.774618 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.774902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.775176 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.775856 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:00.776161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:00.777608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2f80b-875e-4164-92dc-c3415e9f6fed None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:00.787474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 78/158] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:00.788491 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.788776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.789050 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.809666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:00.830312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:00.831548 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:00.836678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:00.867030 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149b32-fd1d-452c-a7d5-078b798bf202 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:00.920783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:00.921875 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:00.922350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:00.922813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:00.949218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 79/159] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:00.949218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:01.078396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:01.079849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:01.137755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eea944-d44a-4be4-9bf8-16cc4c40997f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:01.202159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:01.211369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ca2b-a6ea-4fbd-b3cf-ac82f2be9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:01.212078 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ca2b-a6ea-4fbd-b3cf-ac82f2be9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:01.212358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ca2b-a6ea-4fbd-b3cf-ac82f2be9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:01.212624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ca2b-a6ea-4fbd-b3cf-ac82f2be9cb3 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:01.217864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020ca2b-a6ea-4fbd-b3cf-ac82f2be9cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:01.219334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020ca2b-a6ea-4fbd-b3cf-ac82f2be9cb3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:01.221438 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 80/160] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:00 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:01.222657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6380b5c-4736-46aa-bf6c-3bcf3145dd0a None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:01.222932 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6380b5c-4736-46aa-bf6c-3bcf3145dd0a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:01.223196 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6380b5c-4736-46aa-bf6c-3bcf3145dd0a None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:01.224363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 81/161] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:01.231103 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:01.231522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:01.231795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:01.263237 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:01.264427 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:01.270641 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:01.308216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 81/162] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:01.308882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:01.391177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 82/163] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:01.391965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:01.511064 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df19a6d-1809-43dd-8b2b-cdc8dd2ac70a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:01.573748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248966-9c47-4a4a-89fe-1f37952087b2 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:01.585922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:01.586568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:01.586849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:01.587122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:01.617575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:01.628462 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:01.629112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:01.629432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:01.629700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:01.630876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:01.632479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:01.637056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 83/164] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:01 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:01.637659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:01.716100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:01.736747 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:01.738324 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:01.863109 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 82/165] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:01.863932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:01.887120 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2badc-c62c-406f-a2da-b9506ecd578e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:01.962895 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:01.963601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:01.963881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:01.964145 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:01.984378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:01.992434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:01.993346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:01.994133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:01.996188 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 84/166] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:01.996764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.014135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:02.037661 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5dc47-b890-4501-9bb7-7cb5cbf3869d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:02.104840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:02.105497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:02.105770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:02.106033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:02.106770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=03d11c48f9b14945aa9338b717dc969b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:02.107071 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:02.108542 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:02.119786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 83/167] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:01 2022] GET /identity/v3/role_assignments?user.id=03d11c48f9b14945aa9338b717dc969b&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:02.120456 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.120640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:02.212086 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3833e-ee31-4c7a-a8cb-778d3b5b2067 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:02.288910 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:02.289506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:02.289780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:02.290045 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:02.296346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:02.298305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:02.300573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 85/168] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:01 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:02.307639 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.352033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db88068-155b-493a-8014-5e24f68041ae None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:02.417406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:02.418058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:02.418328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:02.418598 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:02.442062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:02.450459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:02.451639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 84/169] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:02.453081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.491142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:02.500377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644578d9-cf5b-4af2-be04-3a9b041692bc None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:02.569572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:02.580513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:02.581359 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:02.581705 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:02.581983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:02.582820 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:02.583185 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:02.584955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:02.598947 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 86/170] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:02.599594 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.720400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af612e79-3587-40e0-b958-56d0a15d4e88 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:02.788713 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:02.789439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:02.789784 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:02.790060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:02.790796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] RBAC: Adding query filter params (role.id=df09061e3469445199489ef690728a10, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=03d11c48f9b14945aa9338b717dc969b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:02.791108 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:02.792615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:02.797147 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e373-2bc6-4e53-a7d5-9c6ca4d1b905 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:02.801592 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 85/171] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:02 2022] GET /identity/v3/role_assignments?user.id=03d11c48f9b14945aa9338b717dc969b&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=df09061e3469445199489ef690728a10 => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:02.802360 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.848763 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:02.849348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:02.849634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:02.849915 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:02.850604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:02.850911 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:02.852325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:02.866040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 87/172] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:02.881716 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:02.932532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:02.969406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:02.993207 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca591-5ecd-41f6-b9ac-44ef2dc5bc9a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.053837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065d247-7c92-47b9-a056-42581b4a9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.054914 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d247-7c92-47b9-a056-42581b4a9593 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.055397 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d247-7c92-47b9-a056-42581b4a9593 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.055867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d247-7c92-47b9-a056-42581b4a9593 None admin] PATH_INFO: `/v3/users/8875dd4e092c4727887ccb9579eeb3e4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.057437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065d247-7c92-47b9-a056-42581b4a9593 None admin] RBAC: Authorizing `identity:get_user(user_id=8875dd4e092c4727887ccb9579eeb3e4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:03.059193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065d247-7c92-47b9-a056-42581b4a9593 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:03.062043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 86/173] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:02 2022] GET /identity/v3/users/8875dd4e092c4727887ccb9579eeb3e4 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:03.063156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f8c0-d4bf-4430-a517-e7460928656d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.063444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f8c0-d4bf-4430-a517-e7460928656d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.063726 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f8c0-d4bf-4430-a517-e7460928656d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.065056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 87/174] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:03.066403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e7e1-cf0d-4f43-ae57-8e9a0355f043 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.066688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e7e1-cf0d-4f43-ae57-8e9a0355f043 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.066963 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e7e1-cf0d-4f43-ae57-8e9a0355f043 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.069051 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 88/175] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:03.075020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a940e4-9695-4899-b8a0-87b103b83283 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.075308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a940e4-9695-4899-b8a0-87b103b83283 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.075482 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef01f-c8c9-43c3-a133-0f98b8b1e1bc None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.075592 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a940e4-9695-4899-b8a0-87b103b83283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.113159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c5a940e4-9695-4899-b8a0-87b103b83283 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:03.114368 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c5a940e4-9695-4899-b8a0-87b103b83283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:03.146734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.147404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.147683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.147956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] PATH_INFO: `/v3/users/03d11c48f9b14945aa9338b717dc969b` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.151009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] RBAC: Authorizing `identity:get_user(user_id=03d11c48f9b14945aa9338b717dc969b)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:03.152635 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:03.154655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 88/176] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:02 2022] GET /identity/v3/users/03d11c48f9b14945aa9338b717dc969b => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:03.155260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.200980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 89/177] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:03.202714 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.203003 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.203279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.221556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:03.222858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:03.294412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 90/178] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:03.295179 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.297506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:03.326337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf6fa-b2aa-44ba-ad46-5b07500c7934 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.359467 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:03.402014 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5d3f0-3efc-4c88-a191-7544102920dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.402564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5d3f0-3efc-4c88-a191-7544102920dc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.402843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5d3f0-3efc-4c88-a191-7544102920dc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.403116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5d3f0-3efc-4c88-a191-7544102920dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.403975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2554e4-23f6-48ed-bc55-23ab0cddf2c8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.445554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c2115-18c3-4c12-a116-37c874d110af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.446205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2115-18c3-4c12-a116-37c874d110af None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.446480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2115-18c3-4c12-a116-37c874d110af None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.446745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2115-18c3-4c12-a116-37c874d110af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.520930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c2115-18c3-4c12-a116-37c874d110af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:03.522470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c2115-18c3-4c12-a116-37c874d110af None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:03.530480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:03.538734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5d3f0-3efc-4c88-a191-7544102920dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:03.540214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5d3f0-3efc-4c88-a191-7544102920dc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:03.626292 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 91/179] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:03.627761 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47791ff-506a-4bdf-8d21-e7cdaaa02bde None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.628051 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47791ff-506a-4bdf-8d21-e7cdaaa02bde None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.628323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47791ff-506a-4bdf-8d21-e7cdaaa02bde None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.629841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 92/180] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:03.630350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47791ff-506a-4bdf-8d21-e7cdaaa02bde None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.695660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 89/181] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:03.697127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.697434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.697707 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.716437 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:03.717783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:03.734007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:03.761812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47791ff-506a-4bdf-8d21-e7cdaaa02bde None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.763320 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:03.799634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.800175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.800452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.809240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 90/182] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:03.809240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.811703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:03.816113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:03.817249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:03.818236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 93/183] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:03.819024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.920506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d18616-7f10-4be7-a258-987a8b16e335 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.925612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657119a-6586-45ec-b68c-778ce3d2945f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:03.960822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.961401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.961677 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.961978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] PATH_INFO: `/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.963042 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] RBAC: Authorizing `identity:get_project(project_id=27cbeb3191e44e0aba37dfaa4db812ce)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:03.963138 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aabd0c-c7ff-4898-b834-27f96ee5b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:03.963776 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aabd0c-c7ff-4898-b834-27f96ee5b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.964055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aabd0c-c7ff-4898-b834-27f96ee5b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.964327 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aabd0c-c7ff-4898-b834-27f96ee5b6e3 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.964511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:03.965483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aabd0c-c7ff-4898-b834-27f96ee5b6e3 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:03.973433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 91/184] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/projects/27cbeb3191e44e0aba37dfaa4db812ce => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:03.973433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.974001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aabd0c-c7ff-4898-b834-27f96ee5b6e3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:03.974001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 94/185] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:03.974001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19b5a4-e4d9-41ae-9a4a-d309fac53564 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:03.974001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19b5a4-e4d9-41ae-9a4a-d309fac53564 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:03.974001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19b5a4-e4d9-41ae-9a4a-d309fac53564 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:03.974001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 95/186] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:03.974413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19b5a4-e4d9-41ae-9a4a-d309fac53564 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:03.992995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.004463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.079759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19b5a4-e4d9-41ae-9a4a-d309fac53564 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.082242 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8fefe-0117-4f3e-a96d-d4ecd4df9a70 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.115479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.116375 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.116938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.117297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.118121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:04.118531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.120130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.120847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9667ff-15c1-4006-8168-765a1eede5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.121730 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9667ff-15c1-4006-8168-765a1eede5f8 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.122015 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9667ff-15c1-4006-8168-765a1eede5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.122288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9667ff-15c1-4006-8168-765a1eede5f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.129869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 96/187] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.130691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.133790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9667ff-15c1-4006-8168-765a1eede5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-6f9667ff-15c1-4006-8168-765a1eede5f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:04.138566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:04.139634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:04.140428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 92/188] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:04.141063 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.141251 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.141578 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.159908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:04.161137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:04.224632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.229404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 93/189] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:04.241326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.241326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.241908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb2dd-6d94-403a-a0e6-360251d4fb8b None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.277536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.278153 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.278428 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.278695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.279411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=27cbeb3191e44e0aba37dfaa4db812ce, user.id=03d11c48f9b14945aa9338b717dc969b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:04.279837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.281243 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.288474 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 97/190] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/role_assignments?user.id=03d11c48f9b14945aa9338b717dc969b&scope.project.id=27cbeb3191e44e0aba37dfaa4db812ce&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.297528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.343576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa99b8-bd9e-44e7-be43-c8d16448df30 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.383281 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.383959 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.384411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.384780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.385899 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=8875dd4e092c4727887ccb9579eeb3e4) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:04.386320 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.388049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.401782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 94/191] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/role_assignments?user.id=8875dd4e092c4727887ccb9579eeb3e4&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.402885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.427025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0aef4-9200-4fd3-8a79-b19f66edd68f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.466686 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.467383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.467661 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.467933 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.480861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:04.486507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:04.487637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:04.488419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:04.488999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 98/192] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:04.489671 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.511280 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.524408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.572108 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf078fc-1afe-4b9a-abce-f2df79ccb453 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.619954 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.620701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.621041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.621669 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] PATH_INFO: `/v3/users/5d47d6f3a56f40f8b510eb2f710cdaad` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.623236 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] RBAC: Authorizing `identity:get_user(user_id=5d47d6f3a56f40f8b510eb2f710cdaad)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.625338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.626807 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0456-b4a3-4dd9-a607-f58a99e01d10 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.627079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 95/193] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/users/5d47d6f3a56f40f8b510eb2f710cdaad => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.627823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.675646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.676274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.676549 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.676814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.677523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:04.677824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.679241 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.688400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 99/194] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.689574 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.756992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a77f-1056-4f66-a4c3-b7a14d25005b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.783295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.795728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.796388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.796664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.796933 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.797636 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:04.798303 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.799845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.805044 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:04.806273 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a3ccf-30d2-4cd3-873d-057eefaccfeb None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.808327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 96/195] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.809433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.840248 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.840880 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.841155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.841453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.842541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.843999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.845586 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 100/196] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.846364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:04.911939 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6a2f2-b9f9-47a8-af3e-4041307042c0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.944676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63093fd-df1b-49d8-9ab0-c07f3325255f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:04.945226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.945852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.946123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.946391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.978188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:04.978813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:04.979088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:04.979359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] PATH_INFO: `/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:04.993161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] RBAC: Authorizing `identity:get_user(user_id=c30b0e9dd7594b90a4f86c6f6a5e527e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:04.994836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:04.996482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 101/197] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:04.997267 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.000639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.018430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.021789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.023427 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.097365 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee7cf-c8bc-495a-a001-6a1132c2ce93 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.123197 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 97/198] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:05.124060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.135766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.136404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.136680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.136946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] PATH_INFO: `/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.138118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c30b0e9dd7594b90a4f86c6f6a5e527e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.139683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.141429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 102/199] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:04 2022] GET /identity/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:05.142110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.210964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.224668 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.228009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab20c3-8581-4958-b46d-af2cdf918ebf None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.240438 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e476-2532-4cad-8dfa-09f40f2e84a8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.263306 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.263927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.264205 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.264474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.265119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.266622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.276431 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.276981 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.277293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.277560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.289785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 98/200] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:05 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:05.294712 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.357507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.359055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.407732 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e58394-884d-4641-a4e9-eb798f99f6c6 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.437152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.448384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.449046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.449338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.449603 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.451098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.452292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.459467 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 99/201] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:05.459467 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.484408 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 103/202] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:05.484408 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.490175 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.580927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dc72c-47ec-4a99-9a5e-468e319cd1f7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.605317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49b32-b58f-429e-8125-24ff9c9a8832 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.626918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.627537 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.627815 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.628085 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.652770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.653868 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.654150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.654422 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.655177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] RBAC: Adding query filter params (role.id=888d00d671c64fa8aed78ff50a5f2f0c, scope.project.id=072d9903a785453d86ed0052ef7c3e12, user.id=5d47d6f3a56f40f8b510eb2f710cdaad) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:05.655478 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.656937 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.663935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 104/203] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/role_assignments?user.id=5d47d6f3a56f40f8b510eb2f710cdaad&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=888d00d671c64fa8aed78ff50a5f2f0c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:05.664769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.718287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.722041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.723946 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.757931 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.820255 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a82d-86c7-49de-94d3-13b34cbaf902 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.856975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 100/204] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:05.863297 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.866289 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:05.867840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:05.867840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:05.867840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:05.868772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:05.870320 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:05.872054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 105/205] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:05.877952 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:05.987580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b9f65-b96a-4f37-8332-991e2b2b8b0d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:05.990247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:05.992245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33789e-17b0-4b6b-88eb-20c8e7828100 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:06.023174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:06.030883 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:06.031471 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:06.031865 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:06.032340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:06.033497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=c30b0e9dd7594b90a4f86c6f6a5e527e) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:06.034895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:06.035940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:06.039116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9594c4d-e5e6-4998-b1ba-0333d44af1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:06.040097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594c4d-e5e6-4998-b1ba-0333d44af1f5 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:06.041001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594c4d-e5e6-4998-b1ba-0333d44af1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:06.041472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594c4d-e5e6-4998-b1ba-0333d44af1f5 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:06.043031 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9594c4d-e5e6-4998-b1ba-0333d44af1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:06.043854 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 106/206] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/role_assignments?user.id=c30b0e9dd7594b90a4f86c6f6a5e527e&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:06.044986 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9594c4d-e5e6-4998-b1ba-0333d44af1f5 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:06.046784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 101/207] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:05 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:06.057423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:06.187682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534d387-20a1-4784-b7e7-58b7b900a112 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:06.235605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:06.236281 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:06.236569 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:06.236841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:06.237605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] RBAC: Adding query filter params (role.id=df09061e3469445199489ef690728a10, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=c30b0e9dd7594b90a4f86c6f6a5e527e) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:06.237912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:06.239389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ba4f1-4be0-4b80-b377-ce8b1bb5f3e1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:06.245979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 107/208] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:06 2022] GET /identity/v3/role_assignments?user.id=c30b0e9dd7594b90a4f86c6f6a5e527e&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=df09061e3469445199489ef690728a10 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:07.734535 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc03c-af3f-428a-a8fd-955cd6192d12 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:07.735052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc03c-af3f-428a-a8fd-955cd6192d12 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:07.735123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc03c-af3f-428a-a8fd-955cd6192d12 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:07.736886 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 102/209] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:07.743059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ea97-730a-4a1a-a877-b5437f550649 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:07.743596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ea97-730a-4a1a-a877-b5437f550649 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:07.743596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ea97-730a-4a1a-a877-b5437f550649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:07.762221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-4cb0ea97-730a-4a1a-a877-b5437f550649 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:07.763425 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-4cb0ea97-730a-4a1a-a877-b5437f550649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:07.790002 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:07.837707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 108/210] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:07.883147 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad12a4-a64f-47bc-8c4f-4ce76b8dd9f3 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:07.883432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad12a4-a64f-47bc-8c4f-4ce76b8dd9f3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:07.883710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad12a4-a64f-47bc-8c4f-4ce76b8dd9f3 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:07.885362 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 103/211] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:07.890768 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:07.891057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:07.891501 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:07.912564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:07.914185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:07.984105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 109/212] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:08.169139 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad12a4-a64f-47bc-8c4f-4ce76b8dd9f3 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:08.282673 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad12a4-a64f-47bc-8c4f-4ce76b8dd9f3 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:08.321624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:08.323524 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:08.324187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.324461 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.324734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.339719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:08.345240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:08.346152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:08.346941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 104/213] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:08.352161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:08.413609 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:08.429923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:08.440237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06436f-cefd-47f4-a6b2-d4e0b5e7d22f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:08.465284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f7ec0-d7aa-410e-8f6c-c1d166f7156b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:08.477327 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e747-14ce-484a-bb3b-81b6f0d7421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:08.477969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e747-14ce-484a-bb3b-81b6f0d7421e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.478242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e747-14ce-484a-bb3b-81b6f0d7421e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.478511 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e747-14ce-484a-bb3b-81b6f0d7421e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.479594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e747-14ce-484a-bb3b-81b6f0d7421e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:08.481041 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e747-14ce-484a-bb3b-81b6f0d7421e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:08.482650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 110/214] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:08.483744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d6648-8072-4406-a4c4-aed74510eeb1 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.484017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d6648-8072-4406-a4c4-aed74510eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.484285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d6648-8072-4406-a4c4-aed74510eeb1 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.485479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 111/215] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:08.486523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33bcd3-9ad6-4cd7-a0d3-77aa594d50f6 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.486792 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33bcd3-9ad6-4cd7-a0d3-77aa594d50f6 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.487057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33bcd3-9ad6-4cd7-a0d3-77aa594d50f6 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.488214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 112/216] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:08.489979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33bcd3-9ad6-4cd7-a0d3-77aa594d50f6 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:08.507038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:08.507648 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.507929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.508192 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.508865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:08.509165 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:08.510589 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4309b02-a41b-4f96-9c9e-32f0e4f47712 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:08.518851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 105/217] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:08.520007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7002-a9cd-4996-9287-9c4d59bff22e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.520275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7002-a9cd-4996-9287-9c4d59bff22e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.520548 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7002-a9cd-4996-9287-9c4d59bff22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.538030 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b87c7002-a9cd-4996-9287-9c4d59bff22e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:08.539229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b87c7002-a9cd-4996-9287-9c4d59bff22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:08.598251 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33bcd3-9ad6-4cd7-a0d3-77aa594d50f6 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:08.610708 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 106/218] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:08.612046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.612314 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.612564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.638587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:08.639182 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.639480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.639751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.640402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:08.641886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:08.642096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:08.643386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:08.665509 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 113/219] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:08 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:08.674611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:08.696119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:08.707627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:08.749217 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 107/220] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:08.814626 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d57b-c18d-4bc7-a2d7-db730e733130 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:08.853382 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:08.854055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:08.854318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:08.854592 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] PATH_INFO: `/v3/users/64060571c3a145e09af6993cad3d9304` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:08.869724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] RBAC: Authorizing `identity:get_user(user_id=64060571c3a145e09af6993cad3d9304)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:08.871298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:08.873045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 114/221] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:08 2022] GET /identity/v3/users/64060571c3a145e09af6993cad3d9304 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:08.878877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:08.937475 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.001469 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60162e83-ab56-4494-a806-f116c1a065f8 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.040069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:09.044506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.045284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.045619 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.045950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.071783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a342fb-bb33-41ed-a917-70da4a8c58b5 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.100086 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:09.111970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.112785 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.113137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.113520 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.128023 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:09.132835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:09.133941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 115/222] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:09.134940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.143367 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:09.145476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:09.266493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d6e53-308d-4d73-8455-3e75c7f56b6b None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.268439 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 108/223] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:09.274084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.324233 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.325536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.326038 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.326641 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.329082 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:09.343556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:09.350707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:09.351639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:09.352404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:09.354836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 116/224] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:09.360453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:09.360609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.391818 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ff816-7a58-4017-ad06-a32c1b833baf None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.436996 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.437640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.437920 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.438192 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.438986 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:09.439309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:09.440737 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:09.449743 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 109/225] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:09.451262 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.491363 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492537e4-ed2e-4e28-9331-9228831e1eca None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.527532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.528092 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.528368 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.528679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.529795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:09.531248 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:09.537661 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 117/226] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:09.538593 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.572288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f52fc-398a-432f-b5e7-dd88f013a463 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.610967 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.611857 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.612243 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.612881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.613988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:09.614406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:09.615925 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:09.623409 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:09.635891 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 110/227] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:09.635891 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.639052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:09.695125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165aae7f-0d90-4c97-ab6c-a015990ad1e3 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.746330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.747571 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.747951 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.748324 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] PATH_INFO: `/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.749905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] RBAC: Authorizing `identity:get_user(user_id=c30b0e9dd7594b90a4f86c6f6a5e527e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:09.751799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:09.754644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 118/228] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:09.755663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.757092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0d77-17cb-49d8-a394-896c733e0960 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:09.815384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:09.816714 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:09.817389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:09.818034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:09.819424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=64060571c3a145e09af6993cad3d9304) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:09.820122 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:09.822834 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:09.832426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 111/229] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/role_assignments?user.id=64060571c3a145e09af6993cad3d9304&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:09.834027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:09.950766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd34c-776f-4abe-a8c3-5a8fe6ddc1fa None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:10.019719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:10.029420 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:10.031669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:10.032305 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:10.033126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] PATH_INFO: `/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:10.036441 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] RBAC: Authorizing `identity:get_user(user_id=c30b0e9dd7594b90a4f86c6f6a5e527e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:10.039523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:10.040330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:10.043284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 119/230] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:10.053795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:10.145670 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40ffea-e6d6-4beb-83f4-e032174c0b46 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:10.210288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:10.212469 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:10.213172 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:10.213955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:10.216140 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:10.218611 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:10.220702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 112/231] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:09 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:10.229936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:10.277437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a9fb-556c-4ff2-9629-e708e0daee13 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:10.323904 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:10.324573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:10.324849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:10.325158 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:10.328054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:10.329587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:10.331691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 120/232] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:10 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:10.347948 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:10.488388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd55d1-547f-4706-ae56-9a7810021b96 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:10.524274 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:10.532029 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:10.549047 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357d4fe-2469-43a0-a867-b7747a88b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:10.549775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d4fe-2469-43a0-a867-b7747a88b423 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:10.550094 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d4fe-2469-43a0-a867-b7747a88b423 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:10.550542 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d4fe-2469-43a0-a867-b7747a88b423 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263/users/c30b0e9dd7594b90a4f86c6f6a5e527e/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:10.555055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357d4fe-2469-43a0-a867-b7747a88b423 None admin] RBAC: Authorizing `identity:create_grant(project_id=7951a8ad981c4b50962949b6093a1263, user_id=c30b0e9dd7594b90a4f86c6f6a5e527e, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:10.556717 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357d4fe-2469-43a0-a867-b7747a88b423 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:10.592895 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 113/233] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:57:10 2022] PUT /identity/v3/projects/7951a8ad981c4b50962949b6093a1263/users/c30b0e9dd7594b90a4f86c6f6a5e527e/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 13:57:10.603992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199443e-9fe7-49fa-b8fe-319107d28dee None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:10.651028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d3a4-452f-45cd-8b74-3fd6c35bcbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:10.651893 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d3a4-452f-45cd-8b74-3fd6c35bcbd7 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:10.652358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d3a4-452f-45cd-8b74-3fd6c35bcbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:10.652802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d3a4-452f-45cd-8b74-3fd6c35bcbd7 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263/users/c30b0e9dd7594b90a4f86c6f6a5e527e/roles/df09061e3469445199489ef690728a10` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:10.655894 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d3a4-452f-45cd-8b74-3fd6c35bcbd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7951a8ad981c4b50962949b6093a1263, user_id=c30b0e9dd7594b90a4f86c6f6a5e527e, role_id=df09061e3469445199489ef690728a10)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:10.657589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d3a4-452f-45cd-8b74-3fd6c35bcbd7 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:10.681024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 121/234] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:57:10 2022] PUT /identity/v3/projects/7951a8ad981c4b50962949b6093a1263/users/c30b0e9dd7594b90a4f86c6f6a5e527e/roles/df09061e3469445199489ef690728a10 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 13:57:11.637948 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b325-d2a9-4131-8b6f-c974bf87e6ed None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:11.638473 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b325-d2a9-4131-8b6f-c974bf87e6ed None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:11.638726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b325-d2a9-4131-8b6f-c974bf87e6ed None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:11.640681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 114/235] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:11.647126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:11.647698 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:11.648247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:11.677156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:11.678669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:11.705326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55ddd-614a-4ca0-8c79-6bd6daa8f214 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:11.705641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55ddd-614a-4ca0-8c79-6bd6daa8f214 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:11.705876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55ddd-614a-4ca0-8c79-6bd6daa8f214 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:11.707208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 115/236] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:11.712570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:11.712849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:11.713117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:11.753148 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:11.754705 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:11.776127 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 122/237] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:11.870627 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 116/238] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:12.110842 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:12.193639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:12.255824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1ebd9-e2c6-4e82-b835-d969ca5b8c52 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:12.276656 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:12.297087 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:12.298135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.298413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.298816 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.311643 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:12.317237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:12.318168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:12.318946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 123/239] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:12.326148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:12.391990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07defea-bf74-48a1-aef6-ae6f8ca082c1 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:12.420056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:12.443924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:12.444487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.444761 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.445028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.446784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:12.448695 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:12.453290 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 117/240] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:12.457900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:12.501945 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d988d-a8a7-46c9-99a9-a44bbc95badc None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:12.543598 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:12.596086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:12.596715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.596990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.597283 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.597961 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:12.598259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:12.599667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:12.613334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aea557-3395-4b98-a6ee-1606e6b7d118 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:12.627640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 124/241] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:12.634271 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:12.697994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0d89f-ff63-4cfb-85c8-fff69357de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:12.698512 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0d89f-ff63-4cfb-85c8-fff69357de71 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.698798 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0d89f-ff63-4cfb-85c8-fff69357de71 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.699070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0d89f-ff63-4cfb-85c8-fff69357de71 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.699721 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0d89f-ff63-4cfb-85c8-fff69357de71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:12.702310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0d89f-ff63-4cfb-85c8-fff69357de71 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:12.746907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 118/242] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:12 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:57:12.809716 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e83e9-49aa-4602-94d6-3b7cdd09132a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:12.819282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41353c5-8152-45ef-bc1f-2d5054d88e03 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.819615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41353c5-8152-45ef-bc1f-2d5054d88e03 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.819888 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41353c5-8152-45ef-bc1f-2d5054d88e03 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.821306 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 119/243] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:12.830624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.831277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.831829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.858390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:12.859835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:12.860498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:12.861298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] PATH_INFO: `/v3/users/505a406398034468a2594b4a924f6e48` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:12.873788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:12.875099 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:12.890707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] RBAC: Authorizing `identity:get_user(user_id=505a406398034468a2594b4a924f6e48)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:12.894259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:12.905371 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 125/244] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:12 2022] GET /identity/v3/users/505a406398034468a2594b4a924f6e48 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:12.908677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:12.926461 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:12.962192 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 120/245] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:13.002255 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:13.079920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fad2e-23d6-44ab-a18c-6f0d57ef73b8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:13.118059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:13.118683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.118964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.119230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.215094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:13.216674 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:13.257815 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:13.317249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:13.363947 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 126/246] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 13:57:13.371878 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:13.499470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50280357-dd23-4809-bec3-78254a1a8ab0 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:13.514454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e929ec-ca58-4b8c-a564-6f2e632f3b33 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:13.540546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d550fc6-1b68-4010-96fc-3c157cb64a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:13.541619 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d550fc6-1b68-4010-96fc-3c157cb64a7c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.542109 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d550fc6-1b68-4010-96fc-3c157cb64a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.542565 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d550fc6-1b68-4010-96fc-3c157cb64a7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.557593 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268063ad-44f7-4901-9622-e9115e15dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:13.558346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268063ad-44f7-4901-9622-e9115e15dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.558628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268063ad-44f7-4901-9622-e9115e15dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.558906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268063ad-44f7-4901-9622-e9115e15dfc6 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.560769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268063ad-44f7-4901-9622-e9115e15dfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:13.562324 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268063ad-44f7-4901-9622-e9115e15dfc6 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:13.564359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 127/247] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:13 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:13.569525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0e08b-e37d-4278-a836-1f0c9e8410ed None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.569525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0e08b-e37d-4278-a836-1f0c9e8410ed None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.569525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0e08b-e37d-4278-a836-1f0c9e8410ed None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.569525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 128/248] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:13.571057 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d550fc6-1b68-4010-96fc-3c157cb64a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:13.571953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0e08b-e37d-4278-a836-1f0c9e8410ed None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:13.577118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-3d550fc6-1b68-4010-96fc-3c157cb64a7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:13.578399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:13.580702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 121/249] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:13.581507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.582220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.582220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.606324 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:13.607554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:13.646209 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:13.710982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0e08b-e37d-4278-a836-1f0c9e8410ed None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:13.712093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 122/250] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:13.713849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:13.751478 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:13.752175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.752522 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.752866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.753716 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] RBAC: Adding query filter params (role.id=888d00d671c64fa8aed78ff50a5f2f0c, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=505a406398034468a2594b4a924f6e48) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:13.754148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:13.756207 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:13.762828 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 129/251] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:13 2022] GET /identity/v3/role_assignments?user.id=505a406398034468a2594b4a924f6e48&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=888d00d671c64fa8aed78ff50a5f2f0c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:13.865424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20ff4a-1f4d-40ea-940d-df8c33f37145 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:13.909007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:13.909969 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:13.910389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:13.910795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:13.911679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:13.912167 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:13.914379 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:13.930609 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 123/252] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:13.937088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:14.051424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:14.094096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496710-7a9d-4e7b-b82d-cdb076abdba2 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:14.145583 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:14.146244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.146516 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.146783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] PATH_INFO: `/v3/users/64060571c3a145e09af6993cad3d9304` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.153103 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] RBAC: Authorizing `identity:get_user(user_id=64060571c3a145e09af6993cad3d9304)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:14.154626 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:14.156668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 130/253] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:13 2022] GET /identity/v3/users/64060571c3a145e09af6993cad3d9304 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:14.162533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:14.163244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:14.223258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:14.311775 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb059ba-5caa-4c1d-b413-4bde6883fe94 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:14.352971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:14.353949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.355055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.355488 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.357083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:14.358751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:14.360581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 131/254] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:14 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:14.366839 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:14.371689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:14.386174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf420d-5415-4cde-8f41-7f68763a64aa None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:14.450302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a755f17-bf76-4a5c-ad25-b467c565244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:14.450958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755f17-bf76-4a5c-ad25-b467c565244f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.451235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755f17-bf76-4a5c-ad25-b467c565244f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.451505 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755f17-bf76-4a5c-ad25-b467c565244f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.475424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a755f17-bf76-4a5c-ad25-b467c565244f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-7a755f17-bf76-4a5c-ad25-b467c565244f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:14.480171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:14.481226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:14.482074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 124/255] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:14.490942 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402193f2-93a8-4c37-b020-4d6b1ddd6447 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.491216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402193f2-93a8-4c37-b020-4d6b1ddd6447 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.491486 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402193f2-93a8-4c37-b020-4d6b1ddd6447 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.492883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 125/256] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:14.500219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402193f2-93a8-4c37-b020-4d6b1ddd6447 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:14.560788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fde66-1345-468a-9deb-28cd8342ec12 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:14.633288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:14.638772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d29b78-a48d-4635-8b3b-712ff1965314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:14.639684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d29b78-a48d-4635-8b3b-712ff1965314 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.640100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d29b78-a48d-4635-8b3b-712ff1965314 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.640541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d29b78-a48d-4635-8b3b-712ff1965314 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263/users/64060571c3a145e09af6993cad3d9304/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.645954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d29b78-a48d-4635-8b3b-712ff1965314 None admin] RBAC: Authorizing `identity:create_grant(project_id=7951a8ad981c4b50962949b6093a1263, user_id=64060571c3a145e09af6993cad3d9304, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:14.647788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d29b78-a48d-4635-8b3b-712ff1965314 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:14.653027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402193f2-93a8-4c37-b020-4d6b1ddd6447 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:14.677617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 132/257] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:57:14 2022] PUT /identity/v3/projects/7951a8ad981c4b50962949b6093a1263/users/64060571c3a145e09af6993cad3d9304/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 13:57:14.679185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.679656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.680179 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.708154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:14.709368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:14.709792 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:14.710177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:14.711026 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:14.711414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:14.712960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:14.719787 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:14.721644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:14.740155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 126/258] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:14.747308 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:14.861751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:14.880154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 133/259] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:15.002503 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ae306-e4be-4cb2-ae4c-003b07b4cb97 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:15.044516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:15.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:15.045500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:15.045775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] PATH_INFO: `/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:15.049449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c30b0e9dd7594b90a4f86c6f6a5e527e)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:15.050978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:15.052719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 127/260] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:14 2022] GET /identity/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:15.062232 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:15.228695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357d07e-b74b-4dbf-b11b-c9a4ab3bd399 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:15.276180 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:15.277246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:15.277720 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:15.278278 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:15.363640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:15.372349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:15.382517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:15.384361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:15.396520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:15.496983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4ae89-e3a9-4883-8cb5-5ede1b6475a0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:15.539970 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:15.541088 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:15.541644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:15.542109 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:15.575726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:15.586089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:15.587071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:15.587865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:15.599337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 128/261] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:15.608037 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 134/262] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:15.614279 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:15.625746 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:15.753117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:15.805923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f021e-acf9-4bf3-9a1f-618b3d5defdb None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:15.851321 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:15.865728 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437c21-b57d-4513-8ad1-79cee3710be1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:15.881345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:15.882334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:15.882856 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:15.883323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:15.884581 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:15.885136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:15.886788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:15.908738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 129/263] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:15.920720 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:15.946802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:15.947687 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:15.948054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:15.948398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:15.950677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:15.955319 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:15.955467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 135/264] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:15 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:15.964717 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:16.123355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3f3f-b6e0-49d8-b83b-9e6d58b0eae0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:16.182114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbf214-fd37-4665-9aee-99844a3236e3 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:16.214099 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:16.215595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:16.216335 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:16.217048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] PATH_INFO: `/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:16.220036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] RBAC: Authorizing `identity:get_user(user_id=c30b0e9dd7594b90a4f86c6f6a5e527e)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:16.223328 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:16.226962 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 130/265] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:15 2022] GET /identity/v3/users/c30b0e9dd7594b90a4f86c6f6a5e527e => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:16.235057 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:16.248942 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:16.307031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:16.307668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:16.307947 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:16.308218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:16.308954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] RBAC: Adding query filter params (role.id=df09061e3469445199489ef690728a10, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=c30b0e9dd7594b90a4f86c6f6a5e527e) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:16.309289 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:16.310758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:16.327468 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 136/266] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:15 2022] GET /identity/v3/role_assignments?user.id=c30b0e9dd7594b90a4f86c6f6a5e527e&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=df09061e3469445199489ef690728a10 => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:16.394172 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34ae7-ca37-43a8-91d0-34c033b97f8a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:16.454265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bb06f-83fc-4293-893b-662a86a6e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:16.455091 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bb06f-83fc-4293-893b-662a86a6e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:16.455523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bb06f-83fc-4293-893b-662a86a6e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:16.455801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bb06f-83fc-4293-893b-662a86a6e1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:16.561110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bb06f-83fc-4293-893b-662a86a6e1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:16.562664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bb06f-83fc-4293-893b-662a86a6e1f4 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:16.576974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:16.713936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 131/267] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:16.719902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:16.768060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:16.864725 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ed25-daf6-4920-87d9-0f4fda2a5900 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:16.865289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ed25-daf6-4920-87d9-0f4fda2a5900 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:16.865289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ed25-daf6-4920-87d9-0f4fda2a5900 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:16.868077 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 132/268] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:16.874710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319caa9-403e-443d-9411-f8914f11e900 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:16.874929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319caa9-403e-443d-9411-f8914f11e900 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:16.875155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319caa9-403e-443d-9411-f8914f11e900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:16.880931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d31c-cb74-49a3-9fe6-804f7b875628 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:16.913853 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-7319caa9-403e-443d-9411-f8914f11e900 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:16.915107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-7319caa9-403e-443d-9411-f8914f11e900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:16.942204 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:16.943634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:16.944114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:16.944581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:16.946247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:16.947970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:16.950377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 137/269] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:16 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:16.958103 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:17.034000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 133/270] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:17.035137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2659c8-379b-47eb-9895-2d37574bdf7d None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.035424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2659c8-379b-47eb-9895-2d37574bdf7d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.035719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2659c8-379b-47eb-9895-2d37574bdf7d None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.041207 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 134/271] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:17.042590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cec1-2306-4a8c-bedd-14876ade2cab None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.042874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cec1-2306-4a8c-bedd-14876ade2cab None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.043162 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cec1-2306-4a8c-bedd-14876ade2cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.084285 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6e61cec1-2306-4a8c-bedd-14876ade2cab None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:17.085544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6e61cec1-2306-4a8c-bedd-14876ade2cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:17.128258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:17.136276 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:17.152266 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f00029-3b5a-4242-b6b5-42228d6f4654 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:17.180499 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 135/272] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:17.182471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a091-9598-45d9-ab18-4d1d01be700f None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.183334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a091-9598-45d9-ab18-4d1d01be700f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.183803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a091-9598-45d9-ab18-4d1d01be700f None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.185677 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 136/273] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:17.198712 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.199423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.199994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.202508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9466559-4131-4462-af47-053f7352997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:17.203128 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9466559-4131-4462-af47-053f7352997d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.203407 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9466559-4131-4462-af47-053f7352997d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.203741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9466559-4131-4462-af47-053f7352997d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.204544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9466559-4131-4462-af47-053f7352997d None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=c30b0e9dd7594b90a4f86c6f6a5e527e) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:17.205374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9466559-4131-4462-af47-053f7352997d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:17.206824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9466559-4131-4462-af47-053f7352997d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:17.213977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 138/274] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:16 2022] GET /identity/v3/role_assignments?user.id=c30b0e9dd7594b90a4f86c6f6a5e527e&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:17.242527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:17.243803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:17.371528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 137/275] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:17.441430 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9466559-4131-4462-af47-053f7352997d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:17.586016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9466559-4131-4462-af47-053f7352997d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:17.636432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:17.637465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.637933 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.638522 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.639623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:17.640544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:17.642412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:17.644269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 139/276] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:17.651958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:17.691814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:17.781543 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:17.784203 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e63a0-71df-4055-a6a1-0b43cf25b989 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:17.788454 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdb4ca-acee-4198-b5e3-3f798df648ba None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:17.819969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:17.820598 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.820880 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.821156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.821827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:17.823305 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:17.830796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:17.831699 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:17.832135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:17.832551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:17.848867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:17.850808 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 140/277] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:17 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:17.855061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:17.856133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:17.857277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 138/278] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:17.859009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:17.863790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:17.993658 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:17.994028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323d6b-3753-4a90-9218-72b4d465f0ca None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.021777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b2cf2-e746-435d-bd1b-2d47bc7f935e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.050095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.051778 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.052284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.053016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.054153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:18.054679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.056856 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.070692 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 139/279] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:18.076805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:18.079205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.079996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.080269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.080543 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.094754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:18.101659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:18.102611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:18.103424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 141/280] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:18.107578 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:18.109086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:18.230231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee77a-bee8-48df-96b5-10e2abe85f32 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.262170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5369ec-02b8-4f07-beff-21838de63e05 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.285751 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.286698 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.287120 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.287531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] PATH_INFO: `/v3/users/e0a7a6bdf5b14734bfa52eafda28f064` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.309992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a7a6bdf5b14734bfa52eafda28f064)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.312143 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.313804 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.316068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.316068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.316068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.316068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:18.316412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 140/281] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:18 2022] GET /identity/v3/users/e0a7a6bdf5b14734bfa52eafda28f064 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:18.316499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.317532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.328608 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 142/282] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:18.328954 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:18.334120 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:18.341500 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:18.442946 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:18.482294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3826d4-032d-4993-8517-3cce6ad0e476 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.492414 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1223fbc-7723-4303-8762-be5d40ac3a4f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.520525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.521047 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.521351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.521622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.522349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, user.id=e0a7a6bdf5b14734bfa52eafda28f064, scope.system=all) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:18.522652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.524309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce61a-816a-4564-867a-d63d9e209a72 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.530881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 141/283] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Aug 22 13:57:18 2022] GET /identity/v3/role_assignments?user.id=e0a7a6bdf5b14734bfa52eafda28f064&scope.system=all&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:18.532307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54633898-52e3-46c6-9c6b-2e6c69723e7e None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.532490 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54633898-52e3-46c6-9c6b-2e6c69723e7e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.532784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54633898-52e3-46c6-9c6b-2e6c69723e7e None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.534498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 142/284] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:18.543125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.544528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.545042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.545572 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] PATH_INFO: `/v3/users/505a406398034468a2594b4a924f6e48` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.547251 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] RBAC: Authorizing `identity:get_user(user_id=505a406398034468a2594b4a924f6e48)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.549717 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.552155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 143/285] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:18 2022] GET /identity/v3/users/505a406398034468a2594b4a924f6e48 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:18.561872 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.561872 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.561872 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.567246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:18.610395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:18.611799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:18.664703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:18.708458 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db89b8-91b7-4f64-9c55-29a6bbab6094 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.750339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.751391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.752111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 143/286] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:18.752437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.753003 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.755006 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.756726 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.758999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 144/287] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:18 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:18.765209 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:18.844661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:18.878174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff982b-5c3c-4c6c-a723-6c26448cd97e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:18.913815 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:18.914487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:18.914761 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:18.915032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263/users/505a406398034468a2594b4a924f6e48/roles/888d00d671c64fa8aed78ff50a5f2f0c` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:18.916933 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] RBAC: Authorizing `identity:create_grant(project_id=7951a8ad981c4b50962949b6093a1263, user_id=505a406398034468a2594b4a924f6e48, role_id=888d00d671c64fa8aed78ff50a5f2f0c)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:18.918473 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:18.934338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 144/288] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:57:18 2022] PUT /identity/v3/projects/7951a8ad981c4b50962949b6093a1263/users/505a406398034468a2594b4a924f6e48/roles/888d00d671c64fa8aed78ff50a5f2f0c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:19.183571 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:19.304269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377a135-27e7-46f8-8005-c7b136a1c924 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:19.347148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:19.348097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:19.348517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:19.348944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:19.357864 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:19.360778 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:19.367610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:19.368535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:19.369731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 145/289] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:19.375190 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:19.516442 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836780e-de3b-4c1a-a049-6cf88812c83c None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:19.565550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:19.573073 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:19.574061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:19.574552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:19.575232 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:19.576079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:19.576561 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:19.578294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:19.588210 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 145/290] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:19.594250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:19.702734 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c780df-e929-4252-8a56-07d5bc22ba4f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:19.738502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:19.740147 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:19.740950 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:19.741756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] PATH_INFO: `/v3/users/64060571c3a145e09af6993cad3d9304` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:19.744559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] RBAC: Authorizing `identity:get_user(user_id=64060571c3a145e09af6993cad3d9304)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:19.747786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:19.750837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 146/291] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:19 2022] GET /identity/v3/users/64060571c3a145e09af6993cad3d9304 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:19.757952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:19.893669 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981367-a28e-4376-ad59-3e9ef369df20 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:19.944724 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:19.945680 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:19.946164 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:19.946607 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:20.035929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:20.060991 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:20.064107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:20.213592 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 146/292] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:20.219233 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:20.313605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:20.350275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367d86-e04a-4ce6-957f-8db1c91ee148 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:20.385125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a7496-b668-44c8-b4f0-cb1cdd34ba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:20.385799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7496-b668-44c8-b4f0-cb1cdd34ba74 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:20.386081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7496-b668-44c8-b4f0-cb1cdd34ba74 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:20.386354 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7496-b668-44c8-b4f0-cb1cdd34ba74 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:20.387468 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a7496-b668-44c8-b4f0-cb1cdd34ba74 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:20.388922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a7496-b668-44c8-b4f0-cb1cdd34ba74 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:20.390824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 147/293] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:20 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:20.398410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:20.519538 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:20.528685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396759cc-a9e1-43f6-9173-447cbb3389f1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:20.611580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:20.612204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:20.612483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:20.612750 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:20.613522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=64060571c3a145e09af6993cad3d9304) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:20.613830 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:20.615290 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c34965-e5d7-4ba6-aa5b-d096c843b36a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:20.623938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 147/294] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:20 2022] GET /identity/v3/role_assignments?user.id=64060571c3a145e09af6993cad3d9304&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:20.766029 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ecb-e093-4c57-a8ab-fa9c8b03d911 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:20.766398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ecb-e093-4c57-a8ab-fa9c8b03d911 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:20.766589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ecb-e093-4c57-a8ab-fa9c8b03d911 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:20.768085 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 148/295] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:20.773609 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b17f-ae82-41ee-8f5e-0b2c0c194114 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:20.773837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b17f-ae82-41ee-8f5e-0b2c0c194114 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:20.774112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b17f-ae82-41ee-8f5e-0b2c0c194114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:20.793538 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-9be7b17f-ae82-41ee-8f5e-0b2c0c194114 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:20.794746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-9be7b17f-ae82-41ee-8f5e-0b2c0c194114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:20.883414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 148/296] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:21.141862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8a46-bf23-4c79-b0a3-bcc6099045a5 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.142210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8a46-bf23-4c79-b0a3-bcc6099045a5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.142413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8a46-bf23-4c79-b0a3-bcc6099045a5 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.144350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 149/297] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:21.151066 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.151609 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.152067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.170490 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:21.171993 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:21.244748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 149/298] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:21.303688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8a46-bf23-4c79-b0a3-bcc6099045a5 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:21.412189 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8a46-bf23-4c79-b0a3-bcc6099045a5 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:21.447609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e373a-87dc-4e21-b2df-9d81c9a915f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:21.448255 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e373a-87dc-4e21-b2df-9d81c9a915f1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.448539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e373a-87dc-4e21-b2df-9d81c9a915f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.448820 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e373a-87dc-4e21-b2df-9d81c9a915f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.451559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:21.460649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e373a-87dc-4e21-b2df-9d81c9a915f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-832e373a-87dc-4e21-b2df-9d81c9a915f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:21.465694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:21.469529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:21.470679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 150/299] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:21.473659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:21.475851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306a36-7987-4bc9-bd9b-42b0bd66b7e6 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.476261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306a36-7987-4bc9-bd9b-42b0bd66b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.476400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306a36-7987-4bc9-bd9b-42b0bd66b7e6 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.478127 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 151/300] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:21.487959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.488254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.488525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.509443 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:21.513949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:21.516310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:21.609589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 152/301] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:21.610808 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:21.618467 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2b3d-e816-4be4-abf4-1cbe8fae042c None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:21.656804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:21.657531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.657843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.658186 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.659106 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:21.659413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:21.660925 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfdf8e-0d9b-40c2-8021-862f3a5862d9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:21.676296 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 150/302] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:21.678668 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703c7e1-8be5-4e74-a5d2-659bd6663901 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.678954 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703c7e1-8be5-4e74-a5d2-659bd6663901 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.679556 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703c7e1-8be5-4e74-a5d2-659bd6663901 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.680971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 151/303] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:21.681562 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703c7e1-8be5-4e74-a5d2-659bd6663901 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:21.728954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3e5a7-3eb7-4023-a60c-12c990268c2c None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:21.756140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:21.763241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:21.767161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c535ee6-beca-49d3-b434-0ae360cef6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:21.767917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535ee6-beca-49d3-b434-0ae360cef6cd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.768268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535ee6-beca-49d3-b434-0ae360cef6cd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.768546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535ee6-beca-49d3-b434-0ae360cef6cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.769700 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c535ee6-beca-49d3-b434-0ae360cef6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:21.771172 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c535ee6-beca-49d3-b434-0ae360cef6cd None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:21.772913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 153/304] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:21.774040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.774692 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.774692 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.787528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703c7e1-8be5-4e74-a5d2-659bd6663901 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:21.794206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:21.795399 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:21.827129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:21.827759 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.828032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.828362 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] PATH_INFO: `/v3/users/78d5863279d546b4a9e8897c724ac1a5` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.842033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] RBAC: Authorizing `identity:get_user(user_id=78d5863279d546b4a9e8897c724ac1a5)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:21.843524 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:21.845267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 152/305] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:21 2022] GET /identity/v3/users/78d5863279d546b4a9e8897c724ac1a5 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:21.846025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:21.870755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 154/306] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:21.882104 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:21.954215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f187063-43a1-4ad7-8443-66a5552701ce None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:21.990776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:21.991647 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:21.991924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:21.992191 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] PATH_INFO: `/v3/groups` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:21.992812 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:21.992991 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea16581-be7c-4176-9ad3-0a34c67b3afc None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:21.994400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.001799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:22.016079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 153/307] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Aug 22 13:57:21 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:22.017196 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.025142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:22.040896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.041920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.042406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.042845 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.043821 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] RBAC: Adding query filter params (role.id=888d00d671c64fa8aed78ff50a5f2f0c, user.id=78d5863279d546b4a9e8897c724ac1a5, scope.system=all) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:22.044341 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:22.047194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.058478 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 155/308] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Aug 22 13:57:21 2022] GET /identity/v3/role_assignments?user.id=78d5863279d546b4a9e8897c724ac1a5&scope.system=all&role.id=888d00d671c64fa8aed78ff50a5f2f0c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:22.181132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fcdbd-4a56-4690-ad3b-e99c057fa06c None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.205027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.231069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.232079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.232568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.233052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.249377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:22.254859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:22.255782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:22.256577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 154/309] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:22.262099 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.333832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:22.343595 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671da0-ec02-4540-86c9-878a01a0b027 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.391321 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.391847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971afba-88ab-401b-8cf5-d5893e1151a9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.393224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.393623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.394192 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.411886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:22.418423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:22.419943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:22.420930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:22.425327 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 156/310] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:22.427136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.455897 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.456829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.457345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.457796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.458969 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:22.459505 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:22.463193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.485263 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 155/311] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:22.490210 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.508660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:22.590710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5675b-78e6-4a36-b5d7-42017ca60abf None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.643270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.643893 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.644168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.644432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.645098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:22.645444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:22.646945 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.660433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073338-34e4-4114-9107-426ef715e0e2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.662066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 157/312] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:22.663539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.699576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:22.706591 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.707149 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.707646 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.707992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] PATH_INFO: `/v3/users/e0a7a6bdf5b14734bfa52eafda28f064` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.709395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] RBAC: Authorizing `identity:get_user(user_id=e0a7a6bdf5b14734bfa52eafda28f064)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:22.711044 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.713226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 156/313] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/users/e0a7a6bdf5b14734bfa52eafda28f064 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:22.725799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.778847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17ee96-2f16-4efa-9c83-906f0f581dac None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.791581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:22.822551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.823609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.823885 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.824154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] PATH_INFO: `/v3/users/505a406398034468a2594b4a924f6e48` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.825560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] RBAC: Authorizing `identity:get_user(user_id=505a406398034468a2594b4a924f6e48)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:22.827088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.829151 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 158/314] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/users/505a406398034468a2594b4a924f6e48 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:22.835976 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:22.870050 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93288-cb85-47d0-97f5-f906cc81b0ab None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:22.927580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:22.928262 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:22.928545 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:22.928825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] PATH_INFO: `/v3/system/users/e0a7a6bdf5b14734bfa52eafda28f064/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:22.930385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e0a7a6bdf5b14734bfa52eafda28f064, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:22.931904 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:22.959206 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 157/315] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Aug 22 13:57:22 2022] PUT /identity/v3/system/users/e0a7a6bdf5b14734bfa52eafda28f064/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:22.973670 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28019bbd-92bc-47bc-8cbe-8ebd92aa20b1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:23.024449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:23.025882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:23.026437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:23.026930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:23.094741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:23.125678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:23.127390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:23.253576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 159/316] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:23.255662 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:23.314741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:23.370729 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd851e-930b-45aa-b54a-9bba2140c1c4 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:23.417724 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47d5a-39a8-48f5-91f3-019f09e68311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:23.418757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47d5a-39a8-48f5-91f3-019f09e68311 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:23.419225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47d5a-39a8-48f5-91f3-019f09e68311 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:23.419681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47d5a-39a8-48f5-91f3-019f09e68311 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:23.421001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47d5a-39a8-48f5-91f3-019f09e68311 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:23.423132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47d5a-39a8-48f5-91f3-019f09e68311 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:23.425396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 158/317] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:23 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:23.433704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:23.519983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:23.544455 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85f791-a333-4231-8472-152b8613f6f9 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:23.587663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:23.588644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:23.589071 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:23.589373 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:23.590146 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] RBAC: Adding query filter params (role.id=888d00d671c64fa8aed78ff50a5f2f0c, scope.project.id=7951a8ad981c4b50962949b6093a1263, user.id=505a406398034468a2594b4a924f6e48) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:23.590454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:23.591947 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83749-a6f7-4226-95e7-f6525cab1dcf None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:23.600413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 160/318] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:23 2022] GET /identity/v3/role_assignments?user.id=505a406398034468a2594b4a924f6e48&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=888d00d671c64fa8aed78ff50a5f2f0c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:24.433829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548866-2e4e-4013-a13b-17f18a5c5c9a None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:24.434436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548866-2e4e-4013-a13b-17f18a5c5c9a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:24.434436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548866-2e4e-4013-a13b-17f18a5c5c9a None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:24.435683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 159/319] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:24.441523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:24.441955 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:24.442026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:24.461160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:24.462376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:24.514814 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be44ed-cd82-4776-8ed6-3e8f5760c4ce None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:24.515096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be44ed-cd82-4776-8ed6-3e8f5760c4ce None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:24.515364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be44ed-cd82-4776-8ed6-3e8f5760c4ce None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:24.516693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 160/320] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:24.522479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:24.522988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:24.523092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:24.540346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 161/321] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:24.542464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:24.543676 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:24.627654 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 161/322] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:24.867850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:24.944764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:24.949893 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:24.982610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8f0ed-437e-4718-88f2-6696c358a61d None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.004952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:25.021570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.022229 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.022504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.022771 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.034656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:25.039440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:25.040350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:25.041161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 162/323] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:25.046838 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:25.064694 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb3205-e53c-4306-8d31-b5b906fdd708 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.102373 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.103074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.103351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.103620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.104929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:25.106554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:25.108231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 162/324] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:25.113962 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:25.153513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6799f-8555-48b1-8172-52a8660f7c5c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.188376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:25.194803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.195605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.196063 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.196483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.197158 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:25.197490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:25.198899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:25.208034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 163/325] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:25.213814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:25.233662 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b345e41-bed5-4a9a-b178-b0b381bb0af7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.253616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:25.274878 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b7c0b-c0e9-4098-8c1c-38520a25c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.275551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b7c0b-c0e9-4098-8c1c-38520a25c9a2 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.275839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b7c0b-c0e9-4098-8c1c-38520a25c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.276292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b7c0b-c0e9-4098-8c1c-38520a25c9a2 None admin] PATH_INFO: `/v3/groups` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.277276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b7c0b-c0e9-4098-8c1c-38520a25c9a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:25.278778 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b7c0b-c0e9-4098-8c1c-38520a25c9a2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:25.298612 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 163/326] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Aug 22 13:57:25 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:57:25.312107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f888-7829-4eb7-9187-9a35631fb4c6 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.313039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f888-7829-4eb7-9187-9a35631fb4c6 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.313403 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f888-7829-4eb7-9187-9a35631fb4c6 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.315375 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 164/327] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:25.321971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.322588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.322997 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.333425 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab6071-ddad-400b-b5d3-b1c5d4f2e868 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.343867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:25.345309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:25.376544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.377211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.377528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.377800 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] PATH_INFO: `/v3/users/78d5863279d546b4a9e8897c724ac1a5` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.379546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] RBAC: Authorizing `identity:get_user(user_id=78d5863279d546b4a9e8897c724ac1a5)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:25.381077 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:25.383022 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 164/328] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:25 2022] GET /identity/v3/users/78d5863279d546b4a9e8897c724ac1a5 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:25.388980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:25.433303 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 165/329] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:25.461525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:25.507956 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d656-c3ab-49e7-bc18-5257da5d8a13 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.545637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.546300 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.546596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.546851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] PATH_INFO: `/v3/system/users/78d5863279d546b4a9e8897c724ac1a5/roles/888d00d671c64fa8aed78ff50a5f2f0c` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.549122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=78d5863279d546b4a9e8897c724ac1a5, role_id=888d00d671c64fa8aed78ff50a5f2f0c)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:25.550581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:25.577213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 165/330] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Aug 22 13:57:25 2022] PUT /identity/v3/system/users/78d5863279d546b4a9e8897c724ac1a5/roles/888d00d671c64fa8aed78ff50a5f2f0c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:25.775497 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:25.906760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106c881-681b-469e-b00c-b3d9525c1036 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:25.915718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:25.959940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:25.960601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:25.960877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:25.961142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:25.979549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:25.984511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:25.985521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:25.986358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:25.991250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 166/331] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:25.992696 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:26.121844 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d81df-ab37-4dfd-8a04-eb3e142ee687 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:26.156484 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:26.170824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:26.171424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:26.171705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:26.171978 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:26.173042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:26.173433 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:26.174855 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:26.184154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 166/332] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:26.190890 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:26.307104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4673b-6dc3-4b50-b69d-a5871423836e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:26.349863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dfb97-d765-4231-ae62-ad38ae5c1be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:26.350506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dfb97-d765-4231-ae62-ad38ae5c1be4 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:26.350785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dfb97-d765-4231-ae62-ad38ae5c1be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:26.351058 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dfb97-d765-4231-ae62-ad38ae5c1be4 None admin] PATH_INFO: `/v3/users/e0a7a6bdf5b14734bfa52eafda28f064` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:26.352214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dfb97-d765-4231-ae62-ad38ae5c1be4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a7a6bdf5b14734bfa52eafda28f064)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:26.354145 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dfb97-d765-4231-ae62-ad38ae5c1be4 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:26.356115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 167/333] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:26 2022] GET /identity/v3/users/e0a7a6bdf5b14734bfa52eafda28f064 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:26.361949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:26.489428 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdf426-5cfa-4d9c-ac69-64e530b59b72 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:26.526403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:26.527075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:26.527359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:26.527636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:26.528426 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] RBAC: Adding query filter params (role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, user.id=e0a7a6bdf5b14734bfa52eafda28f064, scope.system=all) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:26.528742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:26.530232 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a2ecd-5567-44b2-beb6-26018cb5f898 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:26.543502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 167/334] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Aug 22 13:57:26 2022] GET /identity/v3/role_assignments?user.id=e0a7a6bdf5b14734bfa52eafda28f064&scope.system=all&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:28.153424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e554a7-f606-42ad-be15-f7f41356548b None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:28.154466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e554a7-f606-42ad-be15-f7f41356548b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:28.154954 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e554a7-f606-42ad-be15-f7f41356548b None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:28.156881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 168/335] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:28.162515 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334993fb-10bf-45c9-bfc9-0304583e577f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:28.163423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334993fb-10bf-45c9-bfc9-0304583e577f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:28.163892 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334993fb-10bf-45c9-bfc9-0304583e577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:28.190320 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-334993fb-10bf-45c9-bfc9-0304583e577f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:28.192094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-334993fb-10bf-45c9-bfc9-0304583e577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:28.227386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfbfa-e9f4-461a-a161-a1a86d0fb593 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:28.228033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfbfa-e9f4-461a-a161-a1a86d0fb593 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:28.228501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfbfa-e9f4-461a-a161-a1a86d0fb593 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:28.231656 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 169/336] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:28.237738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fb25-f1dd-4589-9e94-04a78c54c136 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:28.238357 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fb25-f1dd-4589-9e94-04a78c54c136 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:28.238958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fb25-f1dd-4589-9e94-04a78c54c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:28.249644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:28.275365 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 168/337] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:28.276385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-dcc3fb25-f1dd-4589-9e94-04a78c54c136 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:28.280107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-dcc3fb25-f1dd-4589-9e94-04a78c54c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:28.309363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:28.367971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 170/338] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 22 13:57:28.736125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664604b-8c89-4b67-9fbd-0b75937d3bda None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:28.736830 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664604b-8c89-4b67-9fbd-0b75937d3bda None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:28.737363 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664604b-8c89-4b67-9fbd-0b75937d3bda None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:28.739343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 169/339] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:28.745419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:28.746005 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:28.746490 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:28.773506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:28.775579 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:28.857123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 171/340] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:29.054685 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664604b-8c89-4b67-9fbd-0b75937d3bda None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.115574 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.223195 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664604b-8c89-4b67-9fbd-0b75937d3bda None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:29.281800 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:29.282487 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.282762 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.283028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:29.304755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:29.310123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:29.310859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:29.312394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:29.314482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 170/341] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:29.322656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.325882 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252fa6e-6341-436a-b702-3286753f5985 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:29.401616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:29.402216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.402503 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.402782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:29.404438 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:29.470049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:29.487399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:29.488360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:29.489160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 172/342] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:29.489892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.645650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e0b60-bd45-4cfa-af5e-4fa39c94aa7e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:29.684685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3768-477c-44c9-9816-1aa8b1758bd3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:29.708639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:29.709318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.709598 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.709871 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:29.710555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:29.710858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:29.713974 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:29.728663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 171/343] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:29.729855 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.742713 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677762a8-0ab5-42d4-a64e-ec46f800518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:29.743715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677762a8-0ab5-42d4-a64e-ec46f800518f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.744726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677762a8-0ab5-42d4-a64e-ec46f800518f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.745228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677762a8-0ab5-42d4-a64e-ec46f800518f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:29.762153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677762a8-0ab5-42d4-a64e-ec46f800518f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-677762a8-0ab5-42d4-a64e-ec46f800518f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:29.767514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:29.768414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:29.769265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 173/344] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:29.770027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f711-6153-4cf2-a383-b296c96bdc29 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.770211 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f711-6153-4cf2-a383-b296c96bdc29 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.770449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f711-6153-4cf2-a383-b296c96bdc29 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:29.771758 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 174/345] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:29.772516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f711-6153-4cf2-a383-b296c96bdc29 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.790059 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:29.857737 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:29.862555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aab55-9c2e-46be-86d3-cde6a9f27b13 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:29.905999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f711-6153-4cf2-a383-b296c96bdc29 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:29.906963 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:29.910067 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.910067 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.910067 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:29.910067 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:29.910067 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:29.911775 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:29.924471 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 172/346] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:29.925531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:29.951319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:29.952211 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:29.952654 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:29.953066 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.044317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.046176 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.062269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e362b3-a0db-4bdb-a14c-0836fd6dd11d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.066393 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:30.105496 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:30.106382 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.106741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.107124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.107899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:30.108306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.109833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b8530-b198-4425-bde7-c2520e668b82 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.121024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 173/347] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:30.122588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.122976 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.123351 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.146703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:30.148168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:30.167274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:30.169771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 175/348] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:30.171236 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:30.226045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 174/349] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:30.226983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:30.283760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a277d63-6dfd-4907-a428-e42873b070ac None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.302063 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:30.326600 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:30.327273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.327525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.327794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] PATH_INFO: `/v3/users/78d5863279d546b4a9e8897c724ac1a5` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.329395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] RBAC: Authorizing `identity:get_user(user_id=78d5863279d546b4a9e8897c724ac1a5)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.330901 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.333016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 176/350] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Aug 22 13:57:30 2022] GET /identity/v3/users/78d5863279d546b4a9e8897c724ac1a5 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:30.334221 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:30.348136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a70bc-ca7a-4de4-bc55-8e8c5c6ca3b3 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.389709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:30.390630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.391042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.391448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.416680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:30.451769 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a102a2c-96a6-4079-a6ba-1684fb4607a5 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.469918 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.471672 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.491323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:30.492309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.492896 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.493412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.494862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.496736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.499091 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 177/351] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:30 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:30.500249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:30.573097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:30.603247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 175/352] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:30.604209 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:30.632869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847498ca-b253-4c66-bd13-3706758c77f6 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.684905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:30.692442 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:30.693595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.693595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.694058 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.695488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] RBAC: Adding query filter params (role.id=888d00d671c64fa8aed78ff50a5f2f0c, user.id=78d5863279d546b4a9e8897c724ac1a5, scope.system=all) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:30.695941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.697875 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41f34-70f1-4a1c-b94c-e97519bf4d10 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.725228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 178/353] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Aug 22 13:57:30 2022] GET /identity/v3/role_assignments?user.id=78d5863279d546b4a9e8897c724ac1a5&scope.system=all&role.id=888d00d671c64fa8aed78ff50a5f2f0c => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:30.726841 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f98a2-7f13-4ef8-a178-7e37a188bf0d None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.727457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f98a2-7f13-4ef8-a178-7e37a188bf0d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.727762 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f98a2-7f13-4ef8-a178-7e37a188bf0d None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.730715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 179/354] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:30.732152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f98a2-7f13-4ef8-a178-7e37a188bf0d None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:30.755647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e427a-beeb-4f10-8dd5-3af3e0274f09 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.859731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91ecba-492c-4edb-8465-514fad5d4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:30.860737 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91ecba-492c-4edb-8465-514fad5d4489 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.861635 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91ecba-492c-4edb-8465-514fad5d4489 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.861752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91ecba-492c-4edb-8465-514fad5d4489 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.884753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91ecba-492c-4edb-8465-514fad5d4489 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:30.886755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91ecba-492c-4edb-8465-514fad5d4489 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:30.893732 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 176/355] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:30 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:30.895507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:30.897333 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:30.898810 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:30.923036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f98a2-7f13-4ef8-a178-7e37a188bf0d None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:30.930493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:30.931779 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:30.960717 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:31.022601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:31.023400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.024129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.024623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.027133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:31.030070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:31.033302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 180/356] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:30 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:31.034507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.036780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 177/357] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:31.037709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.110590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:31.194553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbead4-eb81-4eef-8e98-d2ef8ac93f94 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:31.212002 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab371253-5aa0-4e91-8825-af6a83dece4f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:31.239456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:31.240095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.240380 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.240800 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.241580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=072d9903a785453d86ed0052ef7c3e12) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:31.241901 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:31.244706 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:31.256267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 181/358] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:31.257140 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.275648 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:31.276333 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.281220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.281220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.304961 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:31.318984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:31.320766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:31.322404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 178/359] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:31.327708 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.364718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:31.469234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b90d16-afaf-48fd-8027-7e54c10bb5be None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:31.532885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705c34-309f-4bde-aedd-0e7ab8f7473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:31.533617 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705c34-309f-4bde-aedd-0e7ab8f7473d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.533871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705c34-309f-4bde-aedd-0e7ab8f7473d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.534153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705c34-309f-4bde-aedd-0e7ab8f7473d None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.538874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705c34-309f-4bde-aedd-0e7ab8f7473d None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:31.540384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705c34-309f-4bde-aedd-0e7ab8f7473d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:31.542447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 182/360] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:31.543906 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837270-6c18-4711-ac5b-b1cb50ebafad None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.544185 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837270-6c18-4711-ac5b-b1cb50ebafad None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.544456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837270-6c18-4711-ac5b-b1cb50ebafad None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.545937 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 183/361] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:31.552588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32837270-6c18-4711-ac5b-b1cb50ebafad None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.572604 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03498b-3b69-4436-8be5-792193d9f7cd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:31.581109 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:31.622367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:31.622998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.623268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.623533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.624208 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:31.624502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:31.625958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa5a42-c46e-4647-8176-d4671dac0d35 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:31.639969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 179/362] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:31.641449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.641833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.642208 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.685833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:31.687080 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:31.748633 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32837270-6c18-4711-ac5b-b1cb50ebafad None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:31.760325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:31.791062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 180/363] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:31.792256 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.814449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:31.815654 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:31.816193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:31.816851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:31.818041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=df09061e3469445199489ef690728a10, scope.project.id=072d9903a785453d86ed0052ef7c3e12) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:31.818586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:31.821134 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:31.837223 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 184/364] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=df09061e3469445199489ef690728a10 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:31.837223 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:31.999539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:32.005645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76a38f-7f50-4123-a609-30ed408b55a1 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:32.029228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd7b7-2292-47a3-8208-06a3de5f28d1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:32.102173 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:32.103020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:32.103361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:32.103688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:32.129703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:32.130305 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:32.130412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:32.130581 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:32.130847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:32.135890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:32.136814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:32.137702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:32.145309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 181/365] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:32.147023 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:32.222259 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:32.267394 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:32.270177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:32.341367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36846-42b6-4ad7-980d-e826c0a2127c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:32.451823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:32.452470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:32.452753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:32.453030 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:32.453748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:32.454141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:32.455683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:32.483208 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 182/366] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:32.484716 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:32.532639 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 185/367] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:32.535782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:32.550564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:32.697204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:32.760957 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a137e-4f79-44a5-b6ad-b612205e0d46 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:32.781995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e442-b6cc-45c5-b2ff-e678712631fc None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:32.836532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:32.839118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:32.839118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:32.839118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:32.857312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:32.858102 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:32.858932 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:32.859270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:32.859601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:32.864270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:32.865323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:32.866116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:32.866711 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 183/368] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:32.872400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:32.968678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:32.970344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.000651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:33.026877 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683356d-8969-43e3-88dd-4755c83f18d9 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.054753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:33.080020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.080962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.081532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.081949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.083843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.086459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.088970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 184/369] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:32 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:33.089734 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.090960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 186/370] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:33.095380 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.221968 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5305a-2b5a-4a54-8acc-2d4da2a93ab0 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.230126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc57cee-0eb0-4b76-88d7-75444b643970 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.260740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.261397 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.261679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.262064 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.262801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:33.263116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.264668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.274602 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 185/371] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:33.275549 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.282020 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.283005 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.283440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.283884 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.285825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.288238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.290575 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:33.292575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 187/372] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:33.294198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.349866 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:33.399563 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1783-b5c5-4098-9467-90062a10de94 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.431659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb35df7-9de5-4d29-8841-b91822ab27db None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.440760 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.441428 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.441711 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.441985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.443190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.444663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.446522 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 186/373] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:33.452223 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.498061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.499228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.499812 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.500323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.565501 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:33.598352 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114e6f2-23b2-42b4-b5cd-4a85599d6267 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.604285 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.606434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.649005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.649836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.650032 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.650306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.651043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=7951a8ad981c4b50962949b6093a1263) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:33.651387 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.652802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.657318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:33.665512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 187/374] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:33.666908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.737958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 188/375] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:33.744588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.915756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980251-f98f-42f9-a4a2-e098fe7e4cbe None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.926905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fd75-f54e-4ce1-a2c5-4d5624e50840 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:33.979558 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.980580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.981060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.981555 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] PATH_INFO: `/v3/projects/5aa389fb5583459aa825686b80b028ae` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.983059 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] RBAC: Authorizing `identity:get_project(project_id=5aa389fb5583459aa825686b80b028ae)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.984741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:33.986662 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 189/376] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/projects/5aa389fb5583459aa825686b80b028ae => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:33.991571 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:33.992206 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:33.992858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:33.993467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:33.993938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:33.995309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:33.997153 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:34.002047 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 188/377] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:34.007206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:34.010839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:34.028877 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:34.117207 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221f9d-6f47-4533-92eb-7b43b862d5ac None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:34.161092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:34.161816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.162094 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.162363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] PATH_INFO: `/v3/groups/fa52881f725844178067827448b01158` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.170938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fafad-4c2a-4108-b816-ef1064cdb527 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:34.177868 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] RBAC: Authorizing `identity:get_group(group_id=fa52881f725844178067827448b01158)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:34.179252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:34.181000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 190/378] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:33 2022] GET /identity/v3/groups/fa52881f725844178067827448b01158 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:34.188423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:34.220140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:34.220821 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.221102 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.221490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.222665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=df09061e3469445199489ef690728a10, scope.project.id=7951a8ad981c4b50962949b6093a1263) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:34.223128 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:34.225291 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763da09-b050-4753-b35f-415bc7745c75 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:34.233818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 189/379] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:34 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=df09061e3469445199489ef690728a10 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:34.290062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:34.334932 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c2ef2-33ba-4e9c-afa0-2c883810f1fc None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:34.377794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:34.378885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.379440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.379930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.381060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] RBAC: Adding query filter params (group.id=fa52881f725844178067827448b01158, role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=5aa389fb5583459aa825686b80b028ae) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:34.381688 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:34.383509 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644bb6-f6cc-4fa7-8623-8c6c33ee3387 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:34.390729 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 191/380] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:34 2022] GET /identity/v3/role_assignments?group.id=fa52881f725844178067827448b01158&scope.project.id=5aa389fb5583459aa825686b80b028ae&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:34.489358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc0a9-2291-4fee-88d3-42d4a4a74482 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.489874 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc0a9-2291-4fee-88d3-42d4a4a74482 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.489874 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc0a9-2291-4fee-88d3-42d4a4a74482 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.491447 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 190/381] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:34.497761 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255890d1-6428-4c85-a111-ab88a5c467a2 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.498447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255890d1-6428-4c85-a111-ab88a5c467a2 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.498925 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255890d1-6428-4c85-a111-ab88a5c467a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.522177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-255890d1-6428-4c85-a111-ab88a5c467a2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:34.523790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-255890d1-6428-4c85-a111-ab88a5c467a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:34.626277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 192/382] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:34.890012 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17b71-6f68-4f4c-909d-d35efbb35a32 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.890668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17b71-6f68-4f4c-909d-d35efbb35a32 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.891153 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17b71-6f68-4f4c-909d-d35efbb35a32 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.893107 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 191/383] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:34.899280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:34.899723 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:34.900115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:34.930037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:34.931261 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:35.023918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:35.035377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 193/384] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:35.095402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17b71-6f68-4f4c-909d-d35efbb35a32 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:35.188164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:35.221517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17b71-6f68-4f4c-909d-d35efbb35a32 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:35.269360 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:35.270009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:35.270284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:35.270552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:35.282929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:35.288504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:35.289465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:35.290254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:35.290872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 192/385] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:35.298471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:35.438095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a988cf-c2b1-4de2-88c2-7bfd6f89bf54 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:35.451958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:35.546631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:35.547854 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:35.548134 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:35.548409 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:35.549271 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:35.549906 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:35.552483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:35.587883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 194/386] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:35.594437 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:35.720124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:35.778480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38568ef-6e25-4555-a3df-810a7bf34175 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:35.835960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab29b1-01fc-4ece-b203-c7e774657d95 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:35.842483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:35.843386 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:35.843773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:35.847136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:35.858757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:35.868300 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:35.880167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:35.881164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:35.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 193/387] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:35.898219 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:35.957906 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:35.958570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:35.958852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:35.959129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:35.960291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:35.961808 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:35.963659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 195/388] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:35 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:35.969755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:36.077231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6d7b7-1b03-4db5-9fc6-ef18ed69c6bd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:36.135144 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c29f-ccd0-4056-84f9-1c9ec5a94508 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:36.137819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:36.138456 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:36.138733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:36.139005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:36.139762 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:36.140066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:36.141625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:36.163094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 194/389] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:36.169697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:36.212997 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:36.229884 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:36.230552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:36.230833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:36.231108 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:36.232478 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:36.233998 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:36.238203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 196/390] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:35 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:36.246128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:36.301427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:36.400377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbb497-0cd9-40dc-a98e-0631f97dccbc None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:36.408738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5257-fdae-4d33-adba-d39517eb59de None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:36.459478 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:36.460124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:36.460404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:36.460740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:36.465154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:36.465154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:36.465154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 195/391] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:36 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:36.477221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:36.494283 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:36.494978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:36.495522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:36.495796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12/groups/71d79f5e82ff4d6eb438db0260e08043/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:36.499875 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=072d9903a785453d86ed0052ef7c3e12, group_id=71d79f5e82ff4d6eb438db0260e08043, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:36.501816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:36.527155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 197/392] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Aug 22 13:57:36 2022] PUT /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12/groups/71d79f5e82ff4d6eb438db0260e08043/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:36.647686 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbe95c-a0e8-44ed-b744-ad6a96845793 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:36.681732 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:36.695232 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461403c-04f6-4ec4-a2c4-c3de052e2088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:36.695916 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461403c-04f6-4ec4-a2c4-c3de052e2088 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:36.696208 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461403c-04f6-4ec4-a2c4-c3de052e2088 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:36.696469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461403c-04f6-4ec4-a2c4-c3de052e2088 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:36.702141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461403c-04f6-4ec4-a2c4-c3de052e2088 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:36.703666 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461403c-04f6-4ec4-a2c4-c3de052e2088 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:36.705899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 196/393] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:36 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:36.711887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:36.809468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:36.868985 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a6702-a490-4772-a83d-e5ad5d268dd2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:36.912234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ef5f-f325-4570-9573-fb819a36b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:36.913553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ef5f-f325-4570-9573-fb819a36b6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:36.914092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ef5f-f325-4570-9573-fb819a36b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:36.914629 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ef5f-f325-4570-9573-fb819a36b6d9 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12/groups/71d79f5e82ff4d6eb438db0260e08043/roles/df09061e3469445199489ef690728a10` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:36.917499 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ef5f-f325-4570-9573-fb819a36b6d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=072d9903a785453d86ed0052ef7c3e12, group_id=71d79f5e82ff4d6eb438db0260e08043, role_id=df09061e3469445199489ef690728a10)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:36.919461 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ef5f-f325-4570-9573-fb819a36b6d9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:36.938337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 198/394] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Aug 22 13:57:36 2022] PUT /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12/groups/71d79f5e82ff4d6eb438db0260e08043/roles/df09061e3469445199489ef690728a10 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:37.138861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c92d-3a68-43c0-90cf-97f28dbb5d7f None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.139366 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c92d-3a68-43c0-90cf-97f28dbb5d7f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.139438 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c92d-3a68-43c0-90cf-97f28dbb5d7f None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:37.140761 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 197/395] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:37.146712 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b47f67-7d43-4738-83f3-e0dee6b75e41 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.147320 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b47f67-7d43-4738-83f3-e0dee6b75e41 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.147787 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b47f67-7d43-4738-83f3-e0dee6b75e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:37.176951 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-a7b47f67-7d43-4738-83f3-e0dee6b75e41 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:37.178672 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-a7b47f67-7d43-4738-83f3-e0dee6b75e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:37.262704 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 199/396] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:37.506595 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81d60-51f3-44f0-8209-7a21c9469ca5 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.506972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81d60-51f3-44f0-8209-7a21c9469ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.507178 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81d60-51f3-44f0-8209-7a21c9469ca5 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:37.508854 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 198/397] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:37.514996 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc721-59cb-496a-9d5f-2f5f4b69b0bb None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.515186 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc721-59cb-496a-9d5f-2f5f4b69b0bb None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.515453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc721-59cb-496a-9d5f-2f5f4b69b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:37.542965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-9fefc721-59cb-496a-9d5f-2f5f4b69b0bb None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:37.544241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-9fefc721-59cb-496a-9d5f-2f5f4b69b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:37.610904 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:37.654915 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 200/398] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:37.697213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2160cd-cf71-4d6b-8ea7-25bddfa125b1 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.697565 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2160cd-cf71-4d6b-8ea7-25bddfa125b1 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.697795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2160cd-cf71-4d6b-8ea7-25bddfa125b1 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:37.699414 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 199/399] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:37.704664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.704956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.705252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:37.734219 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:37.735518 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:37.755157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2160cd-cf71-4d6b-8ea7-25bddfa125b1 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:37.853554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 201/400] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:37.939568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2160cd-cf71-4d6b-8ea7-25bddfa125b1 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:37.991185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:37.991850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:37.992138 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:37.992414 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.007265 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:38.013528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:38.014527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:38.015309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 200/401] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:38.022795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.053816 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.152942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.214579 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d500de-710a-48c1-82dc-72fadde08061 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.229761 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914892b-9c7e-4d8a-bcaa-244576efc93c None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.232211 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.267814 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.268429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.268710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.268975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.269679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:38.269983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.271468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.271736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.272564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.273031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.273604 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.280135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 202/402] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.285352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.291023 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:38.296556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:38.298098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:38.299194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:38.301811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 201/403] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:38.302827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.385527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544f9c-0651-41a1-ae66-4e601ecd4ad2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.405045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a1ef-8851-4836-bd78-8146e9a17880 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.419211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.421426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295370-4048-429e-be8e-5a232827a49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.422385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295370-4048-429e-be8e-5a232827a49a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.422745 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295370-4048-429e-be8e-5a232827a49a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.423021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295370-4048-429e-be8e-5a232827a49a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.439292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65295370-4048-429e-be8e-5a232827a49a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:38.444068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.444910 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-65295370-4048-429e-be8e-5a232827a49a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:38.445012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:38.445961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:38.446736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 203/404] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:38.447393 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295370-4048-429e-be8e-5a232827a49a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.453111 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.453625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.455305 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.456994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.458864 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 202/405] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.459830 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.478394 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.569697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce40551-e8bb-42e2-b333-f371bcbceab4 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.571823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295370-4048-429e-be8e-5a232827a49a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.605607 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.606678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.607226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.607746 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.608618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:38.609169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.609555 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.610227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.610652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.610963 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.611634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:38.611941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.612662 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.613342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.626599 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 204/406] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.627252 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 203/407] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.627695 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.628601 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.673889 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.730046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.732987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91711bb-845d-479f-9c05-5ab15bbf04dc None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.744675 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5423f-9c6a-4fcb-81ed-38832fe41fa1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.768266 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.769292 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.769791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.770421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] PATH_INFO: `/v3/groups/fa52881f725844178067827448b01158` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.771835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] RBAC: Authorizing `identity:get_group(group_id=fa52881f725844178067827448b01158)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.773714 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.775506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 204/408] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/groups/fa52881f725844178067827448b01158 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.776460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.781728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.782482 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.782819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.783095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.784596 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.786345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.788431 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 205/409] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.795386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.904635 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240445e-2f6d-4948-b257-5823b7a7c159 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.917911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:38.923869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad44599-6f6e-4cab-97e7-7b5e35ef76a1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:38.947696 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.948303 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.948672 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.949275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.950304 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.951850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:38.953967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 205/410] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:38.954948 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:38.971244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:38.972480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:38.972904 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:38.973798 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263/groups/71d79f5e82ff4d6eb438db0260e08043/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:38.976453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7951a8ad981c4b50962949b6093a1263, group_id=71d79f5e82ff4d6eb438db0260e08043, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:38.978455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:39.006224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 206/411] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Aug 22 13:57:38 2022] PUT /identity/v3/projects/7951a8ad981c4b50962949b6093a1263/groups/71d79f5e82ff4d6eb438db0260e08043/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:39.006224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:39.047463 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:39.130325 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2344-80f2-41d6-baf1-aa5866302dd8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:39.202060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:39.202704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.202919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.203181 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] PATH_INFO: `/v3/projects/5aa389fb5583459aa825686b80b028ae` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.204778 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa389fb5583459aa825686b80b028ae)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:39.207305 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:39.209307 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 206/412] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:38 2022] GET /identity/v3/projects/5aa389fb5583459aa825686b80b028ae => generated 344 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:39.219381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:39.224466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22023071-6008-456c-8f01-badfd8921cd5 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:39.268397 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:39.269464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.270010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.270471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.272107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:39.274489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:39.277017 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 207/413] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:39 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:39.283721 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:39.323494 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:39.398777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0402fa7-b561-42db-9506-62554edc9e08 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:39.408762 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:39.427199 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cdbee-8120-4ddb-a5a5-6a664245e8cd None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:39.449945 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545cd9-3e62-45cc-bba1-73379901d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:39.450627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545cd9-3e62-45cc-bba1-73379901d545 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.450905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545cd9-3e62-45cc-bba1-73379901d545 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.451177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545cd9-3e62-45cc-bba1-73379901d545 None admin] PATH_INFO: `/v3/projects/5aa389fb5583459aa825686b80b028ae/groups/fa52881f725844178067827448b01158/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.454210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a545cd9-3e62-45cc-bba1-73379901d545 None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa389fb5583459aa825686b80b028ae, group_id=fa52881f725844178067827448b01158, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:39.455764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a545cd9-3e62-45cc-bba1-73379901d545 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:39.467353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e26c1-3590-4d50-8370-10209c4bd2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:39.468367 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e26c1-3590-4d50-8370-10209c4bd2de None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.468832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e26c1-3590-4d50-8370-10209c4bd2de None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.469449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e26c1-3590-4d50-8370-10209c4bd2de None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263/groups/71d79f5e82ff4d6eb438db0260e08043/roles/df09061e3469445199489ef690728a10` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.472613 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e26c1-3590-4d50-8370-10209c4bd2de None admin] RBAC: Authorizing `identity:create_grant(project_id=7951a8ad981c4b50962949b6093a1263, group_id=71d79f5e82ff4d6eb438db0260e08043, role_id=df09061e3469445199489ef690728a10)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:39.474610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e26c1-3590-4d50-8370-10209c4bd2de None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:39.474802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 207/414] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Aug 22 13:57:39 2022] PUT /identity/v3/projects/5aa389fb5583459aa825686b80b028ae/groups/fa52881f725844178067827448b01158/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:39.481238 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb3a94-667c-4c19-89f8-5a8675e6c083 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.481238 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb3a94-667c-4c19-89f8-5a8675e6c083 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.481238 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb3a94-667c-4c19-89f8-5a8675e6c083 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.481551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 208/415] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:39.485214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca414d-129e-46fc-9093-0f837979acf0 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.485214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca414d-129e-46fc-9093-0f837979acf0 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.485214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca414d-129e-46fc-9093-0f837979acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.509546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a3ca414d-129e-46fc-9093-0f837979acf0 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:39.511875 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a3ca414d-129e-46fc-9093-0f837979acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:39.518003 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 208/416] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Aug 22 13:57:39 2022] PUT /identity/v3/projects/7951a8ad981c4b50962949b6093a1263/groups/71d79f5e82ff4d6eb438db0260e08043/roles/df09061e3469445199489ef690728a10 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:39.604735 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 209/417] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:39.804323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3028c-152e-4d4d-bdca-6c752f31d73b None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.804986 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3028c-152e-4d4d-bdca-6c752f31d73b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.805484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3028c-152e-4d4d-bdca-6c752f31d73b None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.807006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 209/418] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:39.812615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:39.813225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:39.813705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:39.832930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:39.834506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:39.865555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:39.919492 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 210/419] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:39.967268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3028c-152e-4d4d-bdca-6c752f31d73b None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.121639 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3028c-152e-4d4d-bdca-6c752f31d73b None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:40.158887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:40.160084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:40.160558 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:40.161071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:40.172767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:40.178801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:40.179771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:40.180559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:40.183158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 210/420] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:40.189336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.289455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.293434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:40.303139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab67f-61b1-45f1-8644-8b45054d679c None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:40.338453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:40.338987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:40.339263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:40.339533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:40.340206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] RBAC: Adding query filter params (name=member) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:40.340495 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:40.342059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:40.352137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 211/421] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:40.369837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.416680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:40.466919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752d9cb-106f-40b8-820d-d57ca93cdc9a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:40.532609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9116f-d7da-403c-9e2a-55e3b5fc7790 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:40.538726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:40.539378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:40.539654 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:40.539919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:40.564685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:40.570568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:40.571481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:40.572280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:40.583702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 211/422] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:40.586634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.611700 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:40.612539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:40.612993 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:40.617069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:40.729348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:40.751733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:40.753572 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:40.791603 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08f9c-16fa-4bea-96be-981e13b1d5d0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:40.817590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:40.855225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:40.855847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:40.856124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:40.856395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:40.857061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:40.857391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:40.858786 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:40.867908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 212/423] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:40.873526 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.967308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 212/424] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 13:57:40.974995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:40.985763 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436763-586b-42e2-b2ef-c48e85146057 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:41.013585 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:41.023523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:41.024162 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.024554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.024835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.156808 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:41.158856 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:41.180680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5513c7-b512-4c22-b554-4f5f2260e4ec None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:41.239259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:41.255392 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:41.257585 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.258043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.258753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.263854 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:41.265527 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:41.267451 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 213/425] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:40 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:41.273345 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:41.363992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 213/426] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:41.369383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:41.411483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:41.443001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9ea86-98c8-495c-b2ec-a2cebb7520aa None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:41.522775 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:41.523837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.524294 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.524775 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.527983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:41.529831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:41.532026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 214/427] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:41 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:41.540505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:41.550405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ca2a-ec04-48cf-a21e-d80d70e1babc None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:41.610502 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:41.612197 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.614091 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.616597 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] PATH_INFO: `/v3/projects/072d9903a785453d86ed0052ef7c3e12` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.618083 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] RBAC: Authorizing `identity:get_project(project_id=072d9903a785453d86ed0052ef7c3e12)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:41.620944 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:41.632132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 214/428] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:41 2022] GET /identity/v3/projects/072d9903a785453d86ed0052ef7c3e12 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:41.633486 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:41.669601 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:41.714102 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c6513-788a-4ec6-8c99-aecc6142dc54 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:41.754422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:41.758139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:41.758831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.759192 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.759541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.760541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=072d9903a785453d86ed0052ef7c3e12) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:41.760920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:41.763053 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454494e-42b3-4b25-8b96-d6d83dfa45a9 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:41.764581 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a3d72-4e01-4ad4-9c6b-cc289eb6bae7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:41.777312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 215/429] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:41 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:41.777312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c6f6-3809-4fe6-b638-8085df019d1e None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.777312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c6f6-3809-4fe6-b638-8085df019d1e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.777312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c6f6-3809-4fe6-b638-8085df019d1e None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.778339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 216/430] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:41.779745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382140-9bcc-44cc-bcf5-04878472595b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.780028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382140-9bcc-44cc-bcf5-04878472595b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.780301 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382140-9bcc-44cc-bcf5-04878472595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.823478 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-2e382140-9bcc-44cc-bcf5-04878472595b None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:41.827229 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-2e382140-9bcc-44cc-bcf5-04878472595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:41.856086 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:41.857150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:41.857648 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:41.858124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:41.866266 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:41.868124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:41.870155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 215/431] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:41 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:41.876414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:41.916618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 217/432] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:42.001161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbf2c-8b5c-459a-9a38-f87dd1d1a00d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.001513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbf2c-8b5c-459a-9a38-f87dd1d1a00d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.001732 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbf2c-8b5c-459a-9a38-f87dd1d1a00d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.003969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 218/433] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:42.010357 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f48fb-3f9c-43b9-bd14-93aaf6826988 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.010656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f48fb-3f9c-43b9-bd14-93aaf6826988 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.010985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f48fb-3f9c-43b9-bd14-93aaf6826988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.057475 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a55f48fb-3f9c-43b9-bd14-93aaf6826988 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:42.058538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a55f48fb-3f9c-43b9-bd14-93aaf6826988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:42.076738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682d24-4370-42a0-a058-995aaa386bcd None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:42.121834 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:42.122968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.123500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.124440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.125689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=df09061e3469445199489ef690728a10, scope.project.id=072d9903a785453d86ed0052ef7c3e12) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:42.126169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:42.127975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:42.132690 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:42.137419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 216/434] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:41 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=072d9903a785453d86ed0052ef7c3e12&role.id=df09061e3469445199489ef690728a10 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:42.162059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 219/435] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:42.312564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:42.329681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8453c-95d6-4f0d-be25-f23b29627307 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.330189 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8453c-95d6-4f0d-be25-f23b29627307 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.330610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8453c-95d6-4f0d-be25-f23b29627307 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.332413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 220/436] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:42.338170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.338440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.338708 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.354760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:42.360574 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:42.362054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:42.455474 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 221/437] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:42.474102 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5e2aa-0d22-4cca-a712-49fc0e3cbf3c None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:42.511787 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:42.512428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.512762 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.513040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.524117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:42.529550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:42.530455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 13:57:42.531889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:42.532570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:42.532643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 217/438] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:42.538203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:42.655794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:42.662205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365db2-7632-4809-97fe-09af2caa6211 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:42.679638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f0a5c-5b6d-4427-9c99-05d71c43fa58 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:42.682764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:42.707003 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:42.707656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.708403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.708403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.721642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:42.726627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:42.727536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:42.728733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 222/439] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:57:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:42.733899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:42.734329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:42.735649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.736335 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.737045 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.738496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] RBAC: Adding query filter params (name=member) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:42.739055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:42.744238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:42.753973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 218/440] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:42.759943 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:42.860473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd645c8-cb5b-44e5-9a34-b4529ec7f4cb None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:42.866541 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7dfe-e233-4440-948b-60f7c7841e21 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:42.896622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:42.897249 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.897526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.897795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.898448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:42.898745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:42.900174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:42.900276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:42.900797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:42.901073 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:42.901432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:42.908260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 223/441] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:42.909116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:42.922408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:42.953817 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:42.976667 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:42.978179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.015023 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ba6b1-d80e-4e43-9bc5-9d66744aeccd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.053789 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.054421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.054703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.054986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.065395 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:43.070554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:43.071411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:43.072191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 224/442] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:43.072846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.084663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 219/443] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:43.089710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.137435 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.173283 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.176897 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ead7d-84ed-4955-82d0-ce525e6d119c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.189263 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bef3-89dc-495c-ba4c-798bec450cd3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.211244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.211945 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.212295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.212572 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.224387 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.225036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.225351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.225583 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.226243 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:43.226548 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.227954 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.235974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 220/444] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.241589 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.281997 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.283645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.341784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0d5d-1194-40ca-b939-564f190be147 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.352320 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.375505 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.376140 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.376417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.376687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.378318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.379764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.380221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.381800 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 221/445] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.382400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.388681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 225/446] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:43.388681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.484518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236573e6-4eee-4125-85e6-bb3b1a238f11 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.485422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823f7e3-5520-4c59-8cd3-a60020b277fa None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.516943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.517241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.517675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.517783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.517958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.518338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.518338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.518610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.519570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.521101 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.522722 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 226/447] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.523486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.564079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.585536 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.587005 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.593991 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.626906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871413b-6063-41c1-9a4d-462614249496 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.662170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.662826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.663079 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.663345 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] PATH_INFO: `/v3/projects/7951a8ad981c4b50962949b6093a1263` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.664488 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] RBAC: Authorizing `identity:get_project(project_id=7951a8ad981c4b50962949b6093a1263)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.665940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.667560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 227/448] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/projects/7951a8ad981c4b50962949b6093a1263 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.668314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.687495 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 222/449] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:43.692129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.767463 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.768704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94acf-dda4-489f-aa2e-99694a65b8be None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.791340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4057-3031-478c-8434-a64bcde32066 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.802694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.803298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.803569 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.803836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.804551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4, scope.project.id=7951a8ad981c4b50962949b6093a1263) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:43.804860 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.806403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.809287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:43.812433 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 228/450] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.813421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.827360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.828013 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.828300 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.828595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] PATH_INFO: `/v3/groups/71d79f5e82ff4d6eb438db0260e08043` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.829871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] RBAC: Authorizing `identity:get_group(group_id=71d79f5e82ff4d6eb438db0260e08043)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.831399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.833351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 223/451] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/groups/71d79f5e82ff4d6eb438db0260e08043 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.839645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:43.942307 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656291a-7905-47c2-9c7e-565d28797d2d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.960367 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e371ec-dad8-4ab4-8c3b-b3009f1cdee2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:43.981252 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:43.981898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:43.982173 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:43.982436 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] PATH_INFO: `/v3/projects/5aa389fb5583459aa825686b80b028ae` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:43.983605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa389fb5583459aa825686b80b028ae)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:43.985106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:43.987543 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 229/452] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/projects/5aa389fb5583459aa825686b80b028ae => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:43.993512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:44.000227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:44.000227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:44.000470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:44.000745 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:44.001450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] RBAC: Adding query filter params (group.id=71d79f5e82ff4d6eb438db0260e08043, role.id=df09061e3469445199489ef690728a10, scope.project.id=7951a8ad981c4b50962949b6093a1263) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:44.001757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:44.003216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:44.010332 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 224/453] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/role_assignments?group.id=71d79f5e82ff4d6eb438db0260e08043&scope.project.id=7951a8ad981c4b50962949b6093a1263&role.id=df09061e3469445199489ef690728a10 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:44.078956 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:44.118535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d651-09c6-4b46-933b-fbe9324c3ab5 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:44.161380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80100-dda3-4a7f-a966-0a962ca0f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:44.162061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80100-dda3-4a7f-a966-0a962ca0f0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:44.162342 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80100-dda3-4a7f-a966-0a962ca0f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:44.162616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80100-dda3-4a7f-a966-0a962ca0f0e0 None admin] PATH_INFO: `/v3/groups/fa52881f725844178067827448b01158` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:44.163869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf80100-dda3-4a7f-a966-0a962ca0f0e0 None admin] RBAC: Authorizing `identity:get_group(group_id=fa52881f725844178067827448b01158)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:44.165399 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf80100-dda3-4a7f-a966-0a962ca0f0e0 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:44.167243 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 230/454] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Aug 22 13:57:43 2022] GET /identity/v3/groups/fa52881f725844178067827448b01158 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:44.173933 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:44.187791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:44.281733 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77cf2c-bef5-43a6-af51-df9aa8121070 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:44.319032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:44.319643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:44.319920 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:44.320190 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:44.321119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] RBAC: Adding query filter params (group.id=fa52881f725844178067827448b01158, role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=5aa389fb5583459aa825686b80b028ae) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:44.322060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:44.322976 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1ab1b-8971-4139-9937-47d402d3c72d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:44.330472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 225/455] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Aug 22 13:57:44 2022] GET /identity/v3/role_assignments?group.id=fa52881f725844178067827448b01158&scope.project.id=5aa389fb5583459aa825686b80b028ae&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:46.839631 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2935eb-b2df-4dd0-9694-ff012ed20905 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:46.840632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2935eb-b2df-4dd0-9694-ff012ed20905 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:46.841127 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2935eb-b2df-4dd0-9694-ff012ed20905 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:46.842928 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 231/456] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:46.848616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f180a8f-2bb3-49bf-87c9-911b7c6a7500 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:46.849458 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f180a8f-2bb3-49bf-87c9-911b7c6a7500 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:46.849919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f180a8f-2bb3-49bf-87c9-911b7c6a7500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:46.868347 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6f180a8f-2bb3-49bf-87c9-911b7c6a7500 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:46.869872 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6f180a8f-2bb3-49bf-87c9-911b7c6a7500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:46.948636 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 226/457] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:47.068869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2680-3076-4c9b-99b9-d2b49db89d0b None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.069532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2680-3076-4c9b-99b9-d2b49db89d0b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.070027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2680-3076-4c9b-99b9-d2b49db89d0b None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.071831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 232/458] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:47.077698 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250c50-9889-4a63-9d53-cda4a2f12cf7 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.078209 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250c50-9889-4a63-9d53-cda4a2f12cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.078768 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250c50-9889-4a63-9d53-cda4a2f12cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.086616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:47.098141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-76250c50-9889-4a63-9d53-cda4a2f12cf7 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:47.099268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-76250c50-9889-4a63-9d53-cda4a2f12cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:47.172742 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 227/459] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:47.206947 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2fe43-3373-4468-9a6f-3a335b0d8d03 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.207557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2fe43-3373-4468-9a6f-3a335b0d8d03 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.208046 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2fe43-3373-4468-9a6f-3a335b0d8d03 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.209882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 233/460] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:47.218663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.219298 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.219763 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.238917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:47.240454 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:47.287634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2fe43-3373-4468-9a6f-3a335b0d8d03 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:47.310631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 228/461] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:47.409570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2fe43-3373-4468-9a6f-3a335b0d8d03 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:47.446560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:47.447201 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.447479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.447749 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.450548 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:47.459011 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:47.460469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:47.475054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:47.476049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:47.477288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:47.477288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:47.477288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:47.477288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 234/462] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:47.482277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:47.547449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:47.559833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:47.609429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9b44b-2bbe-4ec4-8ee9-4367f031ca23 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:47.648264 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:47.648874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.649171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.649457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.650112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:47.650414 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:47.651799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594da931-625c-458f-b1c7-52dfc7b2674b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:47.670498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 229/463] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:47.671051 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031fe4-cd7e-4e3f-abf8-4556b53ebc16 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:47.671876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac57e-1861-4e5e-89b2-76089a65b925 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.672182 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac57e-1861-4e5e-89b2-76089a65b925 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.672486 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac57e-1861-4e5e-89b2-76089a65b925 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.674360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 230/464] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:47.674360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac57e-1861-4e5e-89b2-76089a65b925 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:47.709301 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:47.710046 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.710331 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.710608 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.721654 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:47.723127 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:47.737391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:47.738293 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:47.739129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:47.739129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:47.739129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:47.739129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 235/465] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:47.739338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:47.780820 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac57e-1861-4e5e-89b2-76089a65b925 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:47.783065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:47.805998 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:47.818363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:47.818991 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.819269 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.819542 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.829715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:47.831187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:47.840960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894ef7f-a393-465d-bf01-976cf7b54217 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-b47bcbbf-3753-40c7-8fdb-0743232c4dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:47.845604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:47.846601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:47.847436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:47.847436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:47.847436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:47.847436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 231/466] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:47.848384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.848684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.849214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.866770 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:47.867984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:47.876987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:47.877630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:47.877909 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:47.878176 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:47.878804 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:47.880253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:47.901017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 236/467] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:47 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:47.901995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:47.957708 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 232/468] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:47.959104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:48.023995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:48.030396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379567-44b4-40f5-9462-928b35f18e55 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.069589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.070343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.070689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.071029 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.071759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:48.072128 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.073664 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.087473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 237/469] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:48.094031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:48.111143 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0afb26-f61d-492c-a061-4c2efe3ecfca None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.120173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:48.161852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.162823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.163238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.163518 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.164317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:48.164621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.166559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.181624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 233/470] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:48.189847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:48.220624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747b0c-9da5-4cf8-b400-7a28a5fa6d28 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.271018 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.271887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.272170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.273076 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.273780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.275520 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.311091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 238/471] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:48 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:57:48.313175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:48.323681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c0373-a6f6-46cb-b1a5-56109b9689a2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.334129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:48.373983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.375496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.376124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.376682 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.377544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.379827 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.417912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 234/472] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:48 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:48.453888 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef013e-621c-4a0b-ac71-80dc2798f936 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.496675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.497286 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.497567 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.497838 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.511276 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.512869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:48.530819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:48.531898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:48.532835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:48.532835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:48.532835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:48.532835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 239/473] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:48.539184 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:48.571281 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:48.672981 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66a53b-dba2-47e0-82e4-fcb8c9f5c34b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.711074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.712101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.712574 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.713038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.713922 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:48.714417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.716024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf260-c0a1-4cd6-95e5-2872a748a3f2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.731366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 235/474] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:48.737981 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:48.805031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:48.846445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7bac-0272-4144-8ec4-f7d8759c5e38 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:48.881848 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da93536-8c06-4bca-a9f2-871042a13eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:48.882834 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93536-8c06-4bca-a9f2-871042a13eb1 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:48.883329 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93536-8c06-4bca-a9f2-871042a13eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:48.883811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93536-8c06-4bca-a9f2-871042a13eb1 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:48.884638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da93536-8c06-4bca-a9f2-871042a13eb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:48.886394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da93536-8c06-4bca-a9f2-871042a13eb1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:48.913264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 240/475] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:57:48 2022] POST /identity/v3/users => generated 249 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:57:50.262339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5ec7-676c-4d6c-823c-280789807ac7 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.262862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5ec7-676c-4d6c-823c-280789807ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.262862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5ec7-676c-4d6c-823c-280789807ac7 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.264344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 236/476] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:50.271015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d22d6-de7a-478a-bcb4-ff57b97e59a6 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.271470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d22d6-de7a-478a-bcb4-ff57b97e59a6 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.271544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d22d6-de7a-478a-bcb4-ff57b97e59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.290537 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-162d22d6-de7a-478a-bcb4-ff57b97e59a6 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:50.291739 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-162d22d6-de7a-478a-bcb4-ff57b97e59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:50.362636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 241/477] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:50.689783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2084d-c47f-425c-bebd-d13395c76345 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.690126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2084d-c47f-425c-bebd-d13395c76345 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.690320 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2084d-c47f-425c-bebd-d13395c76345 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.691920 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 237/478] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:50.697509 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768c79-14ed-41f4-b2f6-1e51a7db2cc7 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.697791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768c79-14ed-41f4-b2f6-1e51a7db2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.698061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768c79-14ed-41f4-b2f6-1e51a7db2cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.702154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2084d-c47f-425c-bebd-d13395c76345 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:50.718090 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-94768c79-14ed-41f4-b2f6-1e51a7db2cc7 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:50.719437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-94768c79-14ed-41f4-b2f6-1e51a7db2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:50.788652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:50.808436 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 242/479] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:50.811843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:50.832493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddaa-95b7-4fa5-a4b9-348774a0af53 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.832942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddaa-95b7-4fa5-a4b9-348774a0af53 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.833231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddaa-95b7-4fa5-a4b9-348774a0af53 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.833814 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2084d-c47f-425c-bebd-d13395c76345 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:50.834822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 243/480] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:50.842741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.843096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.843430 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.862471 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:50.863934 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:50.873084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:50.873804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:50.874082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:50.874353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:50.888053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:50.894406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:50.895640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:50.897055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 238/481] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:50.901642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:50.944139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 244/482] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:51.014118 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490047d-abdc-48ce-b462-8b68d813e48e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.049404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.050013 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.050286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.050551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.051265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:51.051573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.052994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.061484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 239/483] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:51.070660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.138492 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.143312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.184935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d123759-02f1-47b5-80c8-a23c0e6bc8a8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.197333 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.224512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.225155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.225455 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.225724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.236492 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.237994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:51.253466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:51.254398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:51.255231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:51.255231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:51.255231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:51.259557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 245/484] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:51.260752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.276682 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e5e6d-4790-4ab9-90eb-141f7538f3b3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.311474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8ffe-3987-4310-9f34-8604ee09ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.311970 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8ffe-3987-4310-9f34-8604ee09ce68 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.312247 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8ffe-3987-4310-9f34-8604ee09ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.312464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8ffe-3987-4310-9f34-8604ee09ce68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.322711 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8ffe-3987-4310-9f34-8604ee09ce68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-53fb8ffe-3987-4310-9f34-8604ee09ce68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:51.327785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:51.328883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:51.329715 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 240/485] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:51.332198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a75e-a484-4b0d-b88e-8be08da53ad8 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.332587 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a75e-a484-4b0d-b88e-8be08da53ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.332862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a75e-a484-4b0d-b88e-8be08da53ad8 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.334154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 241/486] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:51.334875 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a75e-a484-4b0d-b88e-8be08da53ad8 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.363584 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459bc20-9c02-4a5e-ae8d-471d984d83e8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.397037 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.397705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.397989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.398265 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.398642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.398940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:51.399244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.400903 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.413207 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 246/487] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:57:51.414012 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.439728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a75e-a484-4b0d-b88e-8be08da53ad8 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.440314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.476177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a6840-2c90-4d34-abef-c97d1f316760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.476804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6840-2c90-4d34-abef-c97d1f316760 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.477080 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6840-2c90-4d34-abef-c97d1f316760 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.477390 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6840-2c90-4d34-abef-c97d1f316760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.488065 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6840-2c90-4d34-abef-c97d1f316760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f01a6840-2c90-4d34-abef-c97d1f316760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:51.492690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:51.493684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 242/488] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:51.495338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.496098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.496098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.514246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:51.515411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:51.519349 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a4c7-c3d8-4db8-8208-3e66862192d8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.567795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.568485 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.568765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.569042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.569729 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:51.570034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.571449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.580893 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 247/489] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:51.581758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.596802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 243/490] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:51.597593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.669240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.701463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.718550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbd33-d39b-4766-a78a-6e91ebbb2b87 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.719137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74ccb-04bd-4302-9f64-3269000b6463 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.753674 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.754342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.754618 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.754887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.755543 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:51.755710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.755822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.756557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.756969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.757244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.757556 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.765159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 244/491] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:51.765897 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.770712 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.772170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:51.784940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:51.786066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 248/492] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:51.787145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.877759 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aa7a0-5588-4143-8297-c8f4e4428e74 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.894319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.898377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4d265-422f-4b31-a800-dc4444c4b3f8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:51.913810 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.914653 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.915004 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.915207 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.927842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.929353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.934847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:51.935474 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:51.935754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:51.936024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:51.944329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:51.945423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:51.946294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:51.946294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:51.946294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:51.946294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 245/493] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:51.946294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:51.948781 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:51.950317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:51.952971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:51.965709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:51.966755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:51.967996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:51.967996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:51.967996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:51.967996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 249/494] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:51.967996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.052509 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee5afd-feb2-45bf-be71-e016d4cbb477 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.068274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c3144-554a-48b3-a8e5-078f6e0ec6f9 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.088848 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.089483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.089766 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.090039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.090776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:52.091088 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.092561 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.101564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.102194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.102477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.102749 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.113772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:52.118912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:52.119935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 250/495] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:52.125906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.135543 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 246/496] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Aug 22 13:57:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:52.135543 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.158474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.180929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.227590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b6a6-5046-4e0e-93ae-070e0556d288 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.235803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0829434-4078-4a26-8e6b-8d6e23d039d9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.260685 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.261306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.261584 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.261859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.262503 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:52.262811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.264190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.271401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.271992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.272273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.272547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.273208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:52.273517 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.274898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.280691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 251/497] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:52.280691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.286425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 247/498] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:52.287267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.379634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.392198 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd20f7-a4a1-4a5e-b770-7565d32cd8cf None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.397471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed6d7-0db2-49c3-b50a-f96a9985af54 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.409435 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.428781 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.429417 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.429691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.429957 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.430618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:52.430916 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.432297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.432869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.433534 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.433813 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.434087 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.446899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 252/499] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:52.446899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.513157 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.514662 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.558518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286097bc-ba41-4483-813e-abe23690ac70 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.593102 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.593772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.594052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.594348 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.599495 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.602253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.604208 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:52.615454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:52.616444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 13:57:52.617380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:52.617885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 248/500] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:52.617953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 253/501] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:52.617953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.621363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.659350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.728831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d144b-2e4d-42dd-b56c-3a5d73714387 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.734781 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c584f8-8919-465f-b029-a3678d875411 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.764428 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.765028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.765372 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.765643 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.770383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.771010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.771284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.771549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.776496 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.778002 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.778768 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.780235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:52.791849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:52.792758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:52.793616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:52.793616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:52.793616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:52.793616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 254/502] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:52.793847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:52.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:57:52.795586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:52.796080 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.796502 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 249/503] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:52.796502 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.846357 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.890926 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:52.901140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6695d-1ae9-4bb3-95e5-44a865bd1390 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.901729 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8b7c-29bd-4d30-9d18-467d31fc4235 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:52.936404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.937028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.937335 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.937649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.937945 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:52.938358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:52.938579 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:52.938664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.938865 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:52.939164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:52.940178 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.950289 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:52.951745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:52.957519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 250/504] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:52.958346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:52.970040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:52.971106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:52.971987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:52.971987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:52.971987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:52.971987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 255/505] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:52.972197 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.060253 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da505b-2764-4575-b19e-f028180b1ec1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.062697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.075021 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e640-1648-4f25-ba76-03d9e1f1576a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.094921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.095566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.095842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.096108 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.096742 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:53.097036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.098463 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.107417 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.108022 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.108297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.108564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.109308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:53.109640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.109743 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 251/506] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:53.110543 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.111096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.147291 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.153522 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 256/507] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Aug 22 13:57:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:53.154550 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.211169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf771c-7c35-43d2-ab5c-52ce85d9af6c None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.245595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.245595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.245595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.245957 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.255016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20710ab9-9001-4387-81f1-465f7857bbe7 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.275594 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.290581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.291207 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.291486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.291763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.292403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:53.292701 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.294114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.305550 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 257/508] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:53.306329 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.318272 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.319745 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.363955 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.405328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e0be-4fdb-47e0-ab05-e339d8344a3f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.418482 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 252/509] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:53.419504 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.443528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.444163 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.444440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.444710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.452272 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.453904 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:53.465288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:53.466279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 258/510] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:53.467546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.485783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.523236 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c78a-b499-4987-83c6-989251e9f30a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.565839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.566475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.566741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.567020 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.575532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59bdb2-78fc-487e-92c8-d987afdb9a75 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.596756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.612640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.613315 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.613581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.613852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.620619 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.622133 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:57:53.633832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:53.634702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:53.635587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 259/511] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:53.636240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.639857 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.641586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.703167 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.742518 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 253/512] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:53.743042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a541-b7e2-42ce-b98a-fd3765f40b26 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.743277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.777710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.778342 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.778618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.778886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.789669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.791211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:53.806129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:53.807226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:53.812825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:53.812825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:53.812825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:53.812825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 260/513] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:53.812825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.840214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.843488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9cd46-6818-45fb-a872-3020dbf82a9a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.877771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.878370 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.878648 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.878917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.879629 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:53.879931 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.881417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.898187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 254/514] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:53.898793 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:53.913463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beba94-ee39-4b39-861a-da4a73a95120 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:53.927363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:53.948667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:53.949316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:53.949585 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:53.949854 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:53.950537 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:53.950870 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:53.952308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:53.970200 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 261/515] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:53.970856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.004151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b47a7-38cc-4aaa-b550-5baae7752860 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.039707 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.040339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.040616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.040885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.051746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.053225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:54.069111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:54.070053 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:54.070900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:54.070900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:54.070900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:54.070900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 255/516] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:54.072241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.072795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.082872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13b52-de4d-47cd-b076-3b9329b04acf None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.117102 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.118038 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.118378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.118653 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.119296 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:54.119599 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.121047 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.134007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 262/517] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:54.134946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.156421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.184834 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4edd8-4ee8-46b8-b5ce-c80e058529f7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.223095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.223704 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.223983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.224268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.240667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e7a7d-3ba4-44e3-b081-c69b9b88f5e0 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.275060 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.275585 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.275877 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.276135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.276857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=0d23523367ac4aaf8768b750ad23e02b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:54.277167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.278655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.284268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 263/518] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/role_assignments?user.id=0d23523367ac4aaf8768b750ad23e02b&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:54.285041 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.293341 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.295601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.307081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.384452 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.408984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d2d76-c63f-45d0-84d0-33d3051755aa None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.417368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 256/519] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:57:54.418317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.454539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.455289 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.455564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.455834 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.456481 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:54.456782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.458277 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.473279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 264/520] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:54.474183 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.536427 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f237d0-6e17-49cb-b3d2-a708f50f9345 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.560155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.575083 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.575806 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.576152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.576593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.583714 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.585211 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.585517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7dd80-bb15-4fe5-a111-fa669efac44f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:57:54.597226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:54.598124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:54.598973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 257/521] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:54.600198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.626555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.627193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.627473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.627745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.634075 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.639212 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.640780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:54.655940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:54.656994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:54.657872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:54.657872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:54.657872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:54.657872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 265/522] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:54.658096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.707500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fc87e-4dd4-4113-ac66-fb74004348d7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.747816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.748448 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.748759 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.749052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.760063 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.761567 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:57:54.773663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:54.774626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:54.775465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 258/523] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:54.775918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.780593 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a53c-d64d-42ae-a8bf-26633d6344a4 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.810660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.820583 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.821212 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.821539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.821823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.822548 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:54.822923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.824396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.838342 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 266/524] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:54.843787 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.877343 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:54.884826 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bff4e2-c651-401d-b934-120295986fce None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.919296 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.919909 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.920189 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.920460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.921549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:54.921852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.923430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:54.940420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 259/525] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:54.940420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:54.952479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab884a-732c-4856-b807-27802154eb86 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:54.991583 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:54.992191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:54.992480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:54.992753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:54.993460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:54.993869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:54.995204 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:55.012226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 267/526] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:55.012226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:55.053623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3004ada-d7dd-4a7c-930e-948cfe633f02 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:55.073737 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:55.090426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:55.091382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:55.091812 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:55.092069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:55.092790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=4b0911dbafa3421baea46c2cf923a516) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:55.093090 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:55.094585 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:55.100551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 260/527] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:54 2022] GET /identity/v3/role_assignments?user.id=4b0911dbafa3421baea46c2cf923a516&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:55.101105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:55.132623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:55.148607 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339a6dc-c42b-4f75-93eb-67c3a6702dad None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:55.191997 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:55.192745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:55.193109 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:55.193523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:55.201617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:55.203199 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:57:55.221612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:55.222531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:55.223381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:55.226204 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 268/528] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:55.237671 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:55.242665 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5976e-aabb-4aaf-8897-99b644c32a4e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:55.281297 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:55.282148 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:55.282426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:55.282745 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:55.283486 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=2c40b1bbc4994db9a5c7a40c504a659a) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:55.283793 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:55.285341 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:55.297618 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 261/529] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:55 2022] GET /identity/v3/role_assignments?user.id=2c40b1bbc4994db9a5c7a40c504a659a&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:55.355606 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bb802-4b94-45cf-bace-93b12218bc7c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:55.371614 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:55.397065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:55.398346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:55.399190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:55.399656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:55.401040 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:55.401669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:55.404439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906cb96-b92a-49a3-afec-34a826d94e1c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:55.425546 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 269/530] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:55.430367 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:55.527836 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:55.547580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcda83-a3e3-40fb-bcfc-fc3107e08e54 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:55.582624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:55.583240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:55.583528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:55.583801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:55.584526 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=2800cc436ad94811b4e938ee81124b8b) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:55.584835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:55.586340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae56e98-0e67-48de-8f94-04e0c89b1399 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:55.592431 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 262/531] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:57:55 2022] GET /identity/v3/role_assignments?user.id=2800cc436ad94811b4e938ee81124b8b&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:56.545824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518adf71-6338-40fa-9381-9c4927825883 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:56.547648 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518adf71-6338-40fa-9381-9c4927825883 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:56.548216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518adf71-6338-40fa-9381-9c4927825883 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:56.561323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 270/532] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:56 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:56.566413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:56.566892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:56.566989 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:56.589823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:56.591392 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:56.664280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 263/533] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:56.985347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518adf71-6338-40fa-9381-9c4927825883 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.094618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518adf71-6338-40fa-9381-9c4927825883 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:57.131470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:57.132495 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.132980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.133563 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.145560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:57.150589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:57.151526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:57.152358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:57.155445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 271/534] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:57.161515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.244222 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:57.268652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23631c2b-3144-4e29-bc81-895d5a85e6d4 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:57.304253 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:57.304862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.305141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.305441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.306101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:57.306400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:57.307771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cd55e-ec0b-42c2-a08e-78a77d7e04fa None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:57.316544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 264/535] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:57.322115 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.330764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc326e8-dae8-4232-9eec-eea1780e91b1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.331039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc326e8-dae8-4232-9eec-eea1780e91b1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.331338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc326e8-dae8-4232-9eec-eea1780e91b1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.332862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 265/536] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:57:57.338562 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.338890 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.339168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.358707 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:57.360069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:57.361338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:57.443096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4334c-95cd-440a-8367-8339aa86b2e1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:57.443577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 266/537] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:57.481359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:57.482367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.482853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.483328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.494121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:57.495942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-dae0bbf9-cb3f-4fe9-908e-ddd374350e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:57.512155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:57.513130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:57.514008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:57.514008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:57.514008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:57.516251 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 272/538] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:57.522602 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.524132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6ea4-53a4-4a7a-b1db-aadc230cb74d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.524415 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6ea4-53a4-4a7a-b1db-aadc230cb74d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.524684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6ea4-53a4-4a7a-b1db-aadc230cb74d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.525992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 273/539] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:57.530987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.531370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.531781 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.551148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:57.552453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:57.593395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:57.633379 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c21c-8ea0-464b-8688-60476b4ffdb3 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:57.641654 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 274/540] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:57:57.667862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:57.668477 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.668753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.669022 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.669694 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:57.669999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:57.671753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:57.684024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 267/541] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:57.689730 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.702797 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:57.773281 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.809316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c18196-f712-4c7b-aa64-bdb8130672c8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:57.854896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:57.855921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.856454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.856941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.864840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:57.866662 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:57.879124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:57.880086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:57.880986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 275/542] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:57.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.901224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ecf23-197b-4c1d-a84e-609af176c801 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:57.930703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:57.940383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7e06f-5a9d-4f3c-9863-e0a0af665a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:57.941349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e06f-5a9d-4f3c-9863-e0a0af665a81 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.941821 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e06f-5a9d-4f3c-9863-e0a0af665a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.942316 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e06f-5a9d-4f3c-9863-e0a0af665a81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.952724 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7e06f-5a9d-4f3c-9863-e0a0af665a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-53c7e06f-5a9d-4f3c-9863-e0a0af665a81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:57.959400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:57.960334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:57.961121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 268/543] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:57:57.962307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1b0d-173c-44ba-94b4-db5e56401fa3 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:57.962307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1b0d-173c-44ba-94b4-db5e56401fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:57.962307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1b0d-173c-44ba-94b4-db5e56401fa3 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:57.967573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 269/544] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:57:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:57:57.967573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e1b0d-173c-44ba-94b4-db5e56401fa3 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:57.972079 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.007347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a393d-1028-4170-b99e-23ffec0a8d61 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.041022 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.041617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.041882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.042152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.042879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:58.043184 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.044626 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f95096-2eeb-41a5-8a1b-65e566a50924 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.062960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 276/545] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:58.064186 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.064466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.064840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.070330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e1b0d-173c-44ba-94b4-db5e56401fa3 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.084872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:57:58.086136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:57:58.104547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.105139 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.105454 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.105726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.106481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:58.106789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.108203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.118742 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 270/546] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:58.119620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.160796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 277/547] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:57:58.161706 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.175533 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.227572 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.238090 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15694-c45e-4f61-8b0f-0e0b809408d0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.274769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354baf4-e7ad-4ad6-b952-e999e68eb31b None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.279984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.280668 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.280952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.281314 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.291810 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:58.297276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:58.298229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 271/548] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:58.299228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.317598 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.318239 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.318519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.318789 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.330541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.332016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:58.346634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:58.347709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:58.348725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:58.348725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:58.348725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:58.352278 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 278/549] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:58.353039 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.412381 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a98ad-9946-4a13-98f8-823503fece84 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.426433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.452508 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.453350 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.453626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.453998 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.457474 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26948768-22d7-41b6-b86a-7f27534af30a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.466684 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.468170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.469139 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:58.491860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:58.492844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:58.493754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:58.493754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:58.493754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:58.493754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 272/550] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:58.494708 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.502924 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.503541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.503818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.504091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.504754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:58.505055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.506503 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.516105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 279/551] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:58.517217 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.605411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88e692-ace0-446e-b165-c59abb4f6e56 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.629600 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5cd56-6f11-4f3c-8727-10374ae05030 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.641384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.641992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.642268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.642511 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.643161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:58.643450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.644893 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.656524 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 273/552] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:58.657428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.664437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.665068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.665371 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.665644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.676689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:57:58.681678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:57:58.681886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:58.682858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:57:58.683754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:58.685524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 280/553] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:58.686352 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.718689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.761921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91f47-af33-479c-8272-ec804770003b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.788033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16afbb-3c46-433b-bbd7-4120b586cc71 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.794788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.795395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.795666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.796278 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.796997 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:58.797327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.798957 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.809853 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 274/554] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:58.810593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.823534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.824189 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.824465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.824729 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.835759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.837275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:58.851581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:58.852677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:58.853589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:58.853589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:58.853589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:58.853589 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 281/555] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:58.853915 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.897296 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.915267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a875f-724c-4dc7-94ca-52c28093ed3b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.939069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:58.948440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.949075 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.949381 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.949655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.954746 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d34d-61ab-4f5d-9650-0168ad2d00e7 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:58.956551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.958056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:57:58.969531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:58.970500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 275/556] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:58.971372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:58.994743 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:58.995369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:58.995642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:58.995905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:58.996561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:58.996861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:58.998247 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.006388 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 282/557] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:59.007164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.071626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8ead-b36a-4012-b5af-ad4f2c4658f3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.105973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46d53e-23cb-4865-82df-10d2e43b790a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.106884 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.107513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.107785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.108041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.115829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.117283 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:59.128270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:59.129794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 276/558] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:59.131286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.134579 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.143820 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.144440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.144748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.145015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.145673 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:59.145974 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.147338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.159475 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 283/559] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:59.160276 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.169165 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.233287 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478a31-2578-44c6-9fef-51980c74f54b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.261410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5851d6-82ca-43d8-b9b5-8093cfd00fce None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.266871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.267475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.267776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.268039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.268722 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:59.269024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.270510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.292701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 277/560] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:59.292701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.301557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.302187 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.302464 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.302733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.312728 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.314199 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:59.328929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:59.329954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:59.330853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:59.330853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:59.330853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:59.330853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 284/561] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:59.330853 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.354487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.388205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.394899 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240c9b-0770-4eba-9838-0d800c14d1a0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.430670 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.431283 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.431383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759eda4-4c79-4080-b019-93f12141f8ed None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.431563 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.431838 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.432560 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:59.432871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.434370 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.451231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 278/562] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:59.452019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.469215 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.470055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.470477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.470751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.478580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.480042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:57:59.491098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:59.492043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 285/563] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:59.493623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.558976 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361d4e-56ad-49a8-8482-44086eab2ed7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.579614 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.594284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.595686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.595686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.595686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/0d23523367ac4aaf8768b750ad23e02b/roles/681e1245c1ba4c49b5406a98be97a03e` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.599165 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f6e67-f957-4cc8-8ecd-f66245fd7762 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.610576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=0d23523367ac4aaf8768b750ad23e02b, role_id=681e1245c1ba4c49b5406a98be97a03e)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.612033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.617163 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.625583 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 279/564] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:57:59 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/0d23523367ac4aaf8768b750ad23e02b/roles/681e1245c1ba4c49b5406a98be97a03e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:57:59.626387 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.644627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.645398 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.645744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.646081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.646836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:59.647196 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.648699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.667479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 286/565] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:59.667479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.763565 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68321-7019-4077-a928-ff40af1903c9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.777437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68feb08-7837-43af-8e69-5e343208d95b None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.804178 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.804718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.805001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.805303 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.817984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.819462 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.823911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.824702 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.825084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.825399 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.826131 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:59.826435 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.827876 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:57:59.835009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:57:59.836112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:57:59.837218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:57:59.837218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:57:59.837218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:57:59.838422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 280/566] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:57:59.839239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.846636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 287/567] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:57:59.847669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:57:59.865350 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.884150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:57:59.950318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfdc24-da2c-4f60-8c5c-18fa4e85983a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.959533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1dc71-da9f-42e7-8fb3-801ea2908d8f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:57:59.987239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.987877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.988153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.988434 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.996431 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:57:59.996976 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:57:59.997619 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:57:59.997896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:57:59.997994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:57:59.998175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:57:59.998794 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:57:59.999100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.000498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:00.010187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:00.011365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 13:58:00.012521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:00.018584 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 281/568] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:00.018584 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.022296 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 288/569] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:00.023152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.109014 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.121159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.129135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2275-ee36-475c-9edb-d351a5cef3c3 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.132026 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4891e9-f8fb-4709-8d12-23eb8996c013 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.165954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.166197 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.166659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.166765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.166942 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.167120 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.167220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.167487 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.168266 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:00.168634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.170161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.178612 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.180080 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.194703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 289/570] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:00.194703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:00.194941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:00.195992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:00.200837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:00.200837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:00.200837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:00.200837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 282/571] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:00.200837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.304712 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951100ce-65a1-41e3-a220-414151ddcbb1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.308587 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fddd5-5619-41aa-ae1f-60fdd07f4549 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.340793 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.341450 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.341755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.341994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.343800 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.344494 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.344869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.345137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.347214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.350181 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.351842 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.357500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.359010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:00.363336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:00.364400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:00.365402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:00.365871 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 290/572] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:00.366202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:00.379506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:00.380686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:00.381955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:00.381955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:00.381955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:00.381955 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 283/573] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:00.383924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.388287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.477980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682f8f0-3847-4858-936f-a11d8af77f4a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.487372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf17c84-4276-47b9-ba21-b42aaab1cf66 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.512784 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.513429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.513710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.513975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.514622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:00.514931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.516327 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.523062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.523679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.523939 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.524205 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.524892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:00.525207 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.526688 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.534013 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 291/574] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:00.534013 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.545524 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 284/575] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:00.552397 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.613070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.626597 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.658217 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaffe9-3c36-473b-bd7d-fb21729e1167 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.680807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaf137-6bca-4796-8ed5-dc6478347e75 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.693857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.694476 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.694754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.695026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.695667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:00.695971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.697389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.710033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 292/576] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:00.710670 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.725817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.726736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.727079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.727345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.734873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.736336 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:00.747719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:00.748645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:00.750228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:00.754008 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 285/577] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:00.755012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.817694 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f51e-19c5-4ba4-83c4-52f6edd62202 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.855105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.855771 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.856056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.856315 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/4b0911dbafa3421baea46c2cf923a516/roles/681e1245c1ba4c49b5406a98be97a03e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.858846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.859024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177f86-13e6-426a-b50d-c1d2275fd04a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:00.868854 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:00.874003 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=4b0911dbafa3421baea46c2cf923a516, role_id=681e1245c1ba4c49b5406a98be97a03e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.877427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.895627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 293/578] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:58:00 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/4b0911dbafa3421baea46c2cf923a516/roles/681e1245c1ba4c49b5406a98be97a03e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:58:00.896779 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:00.908556 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:00.909676 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:00.910021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:00.910395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:00.918700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:00.920391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:00.933938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:00.934930 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:00.935934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:00.941136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 286/579] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:00.942657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:01.067464 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce92a72-4df6-41c7-81b0-b3c92633e141 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:01.070815 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78040e4e-cb8e-4213-abb3-6ede0f77dd20 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:01.115403 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:01.116355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:01.116851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:01.117167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:01.117610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:01.117905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:01.118180 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:01.118448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:01.119139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:01.119324 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:01.119421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:01.119923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:01.120917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:01.121822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:01.135431 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 294/580] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:01.136692 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 287/581] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:01.141129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:01.143829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:01.186691 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:01.201595 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:01.257218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c2cc5-6111-4468-be32-edec7fd5e85d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:01.271453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd642-c2de-4663-a5c6-feb4da7640bf None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:01.293648 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408c4e4-000a-4c95-80c1-26b6d9f67c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:01.294326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408c4e4-000a-4c95-80c1-26b6d9f67c1c None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:01.294595 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408c4e4-000a-4c95-80c1-26b6d9f67c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:01.294867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408c4e4-000a-4c95-80c1-26b6d9f67c1c None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/2c40b1bbc4994db9a5c7a40c504a659a/roles/681e1245c1ba4c49b5406a98be97a03e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:01.308896 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c590073-7826-40e4-bbd9-dced5fbde17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:01.309728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590073-7826-40e4-bbd9-dced5fbde17a None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:01.310099 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590073-7826-40e4-bbd9-dced5fbde17a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:01.310468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590073-7826-40e4-bbd9-dced5fbde17a None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/2800cc436ad94811b4e938ee81124b8b/roles/681e1245c1ba4c49b5406a98be97a03e` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:01.310785 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408c4e4-000a-4c95-80c1-26b6d9f67c1c None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=2c40b1bbc4994db9a5c7a40c504a659a, role_id=681e1245c1ba4c49b5406a98be97a03e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:01.313334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408c4e4-000a-4c95-80c1-26b6d9f67c1c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:01.328857 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c590073-7826-40e4-bbd9-dced5fbde17a None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=2800cc436ad94811b4e938ee81124b8b, role_id=681e1245c1ba4c49b5406a98be97a03e)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:01.330765 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c590073-7826-40e4-bbd9-dced5fbde17a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:01.332931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 295/582] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:58:01 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/2c40b1bbc4994db9a5c7a40c504a659a/roles/681e1245c1ba4c49b5406a98be97a03e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:58:01.360225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 288/583] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:58:01 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/2800cc436ad94811b4e938ee81124b8b/roles/681e1245c1ba4c49b5406a98be97a03e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:58:01.936749 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ab54-56a7-4b82-aa16-26bd495109aa None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:01.937330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ab54-56a7-4b82-aa16-26bd495109aa None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:01.937330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ab54-56a7-4b82-aa16-26bd495109aa None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:01.938969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 296/584] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:01.944387 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:01.944802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:01.944947 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:01.963487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:01.964686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:02.034680 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 289/585] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:02.356763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ab54-56a7-4b82-aa16-26bd495109aa None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:02.458041 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:02.465594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ab54-56a7-4b82-aa16-26bd495109aa None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:02.507130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:02.507773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:02.508046 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:02.508314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:02.521466 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:02.526467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:02.527486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:02.528310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 297/586] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:02.534609 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:02.548230 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:02.648958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92de65-2a17-4ce0-9125-8e13eaa8f317 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:02.685466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:02.686168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:02.686447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:02.686729 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:02.687624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:02.687926 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:02.689416 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:02.698245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 290/587] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:58:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:02.703701 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:02.813997 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6766ae-8d21-4b11-9914-4c5b80ffe2ec None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:02.849646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:02.850284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:02.850561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:02.850827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:02.861177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:02.862680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:02.877699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:02.878668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:02.879970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:02.879970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:02.879970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:02.879970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 298/588] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:02.884718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:02.952640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:02.989870 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db5820-ee3a-4ae4-bc66-766943a4751c None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:03.024813 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:03.025452 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.025728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.025994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.026637 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:03.026943 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:03.028317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:03.042002 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 291/589] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:03.047931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:03.057668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:03.187110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e137c1-d846-4671-8d23-80e2a1a1f04d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:03.223012 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:03.223567 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.223848 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.224156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.232677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:03.234219 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-b38637e8-20dc-4268-bbab-35b8beba0f05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:03.246141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:03.247121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:03.249015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 299/590] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Aug 22 13:58:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:03.255500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:03.284740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2874-df4e-4b21-9a63-f14c0531191e None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.285062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2874-df4e-4b21-9a63-f14c0531191e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.285307 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2874-df4e-4b21-9a63-f14c0531191e None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.287704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 300/591] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:03.294902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.295285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.295663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.318181 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:03.319765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:03.374517 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca175a-b488-421a-b043-c2ff71a85d03 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:03.398874 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:03.404198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:03.414167 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:03.414923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.415048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.415271 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 301/592] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:03.415387 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.415995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:03.416291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:03.429946 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130c4a6-3862-4ca0-a26a-d8ee800cc04f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:03.455049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 292/593] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Aug 22 13:58:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:03.460944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:03.573856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6747d9e-a5f7-4458-ab23-8392b60872f9 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:03.608940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5106-016c-4190-be8e-41379add5345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:03.609646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5106-016c-4190-be8e-41379add5345 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.609982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5106-016c-4190-be8e-41379add5345 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.610275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5106-016c-4190-be8e-41379add5345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.672041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed962-f22c-46a7-8aa1-f77d97e6e113 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.672381 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed962-f22c-46a7-8aa1-f77d97e6e113 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.672722 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed962-f22c-46a7-8aa1-f77d97e6e113 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.674504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:03.675355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 293/594] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:03.676767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde096d-64f6-41ba-93be-7d9ebdf774b5 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.677043 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde096d-64f6-41ba-93be-7d9ebdf774b5 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.677344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde096d-64f6-41ba-93be-7d9ebdf774b5 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.678843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 294/595] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:03.681224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288463-8091-469f-8c47-f03f40ae5077 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.681601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288463-8091-469f-8c47-f03f40ae5077 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.682030 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288463-8091-469f-8c47-f03f40ae5077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.683087 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a5106-016c-4190-be8e-41379add5345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:03.684838 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a5106-016c-4190-be8e-41379add5345 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:03.700496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-93288463-8091-469f-8c47-f03f40ae5077 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:03.701806 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-93288463-8091-469f-8c47-f03f40ae5077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:03.770363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 295/596] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:03.771705 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.772079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.772292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.788912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 302/597] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 13:58:03.789778 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5106-016c-4190-be8e-41379add5345 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:03.790296 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:03.791497 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:03.870671 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 296/598] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:03.871904 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:03.901219 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:03.909735 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5106-016c-4190-be8e-41379add5345 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:03.936703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:03.954732 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:03.955991 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:03.956838 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:03.957508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:03.976955 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:03.981715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:03.982625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:03.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:03.988026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 303/599] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:03.988907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.012051 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3edb-62d0-496d-baa9-22cad0f45f78 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.058487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.059508 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.060539 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.061029 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.073643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.075119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:04.090268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:04.091246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:04.092136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:04.092136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:04.092136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:04.092136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 297/600] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:04.097255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.115387 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac2be-2c44-4ff3-b411-cbf5460dcfc7 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.151381 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.151909 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.152183 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.152453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.153110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:04.153434 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.154807 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.164296 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 304/601] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:04.165102 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.185454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.204388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.208525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023788-9e4a-4193-a01d-d309bac951ba None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.241674 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.242275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.242549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.242816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.243451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:04.243748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.245112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.257566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 298/602] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:04.258547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.267471 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd83c0-ba1b-4f05-825d-dee3d21ca6c5 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.300388 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.301018 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.301326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.301599 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.312376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:04.318122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:04.319114 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:04.320025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:04.321350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 305/603] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:04.322317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.360292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e918-7002-473f-baf8-3fe1839cb72d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.395481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.396107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.396383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.396650 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.401807 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.407965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.409489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.424183 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453571-c282-4162-9c56-465f927ff983 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:04.425159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:04.426158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:04.427683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:04.427683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:04.427683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:04.427683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 299/604] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:04.427683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.440071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.461452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.462191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.462530 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.462869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.476803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:04.480225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:04.481259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 306/605] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:04.482285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.541068 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb4dd-8bf2-4ef1-8659-b7709ffa3942 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.577282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.577967 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.578248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.578521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.585329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.586833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.596721 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebead3-bcc7-4f73-b809-866638ec5fbf None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:04.597805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:04.598664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:04.599552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 300/606] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:04.600426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.635555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.636159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.636461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.636725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.637412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:04.637709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.639072 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.644253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.648182 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 307/607] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:04.649260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.669227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.701198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94be5-dcc0-4503-9139-7b7f84ead3cf None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.735136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.735737 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.736012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.736278 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.736911 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:04.737244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.738623 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.749323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fd42b-f46d-46fd-be02-6edc7ecce9a1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.750163 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 301/608] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:04.750987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.784042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.784650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.784920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.785200 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.785868 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:04.786168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.787532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.795590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 308/609] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:04.796937 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.855395 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.855767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0503cf-4974-4e98-97a9-3d3a34aacaf2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.884580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:04.890827 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.891437 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.891732 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.891999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.892695 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:04.893001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.894493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.894784 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42d34-bd73-49ca-8e93-c261c71eef5e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:04.906277 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 302/610] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:04.906878 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:04.931422 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:04.931967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:04.932242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:04.932570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:04.943150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:04.944709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:04.959540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:04.960524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:04.961811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:04.961811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:04.961811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:04.961811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 309/611] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:04.961811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.016375 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3d6e-6409-4eb5-bc73-957cfb388da9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.051238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.051861 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.052142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.052412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.059846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.061320 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.064899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bcb46-119c-4899-9614-8224196cfe3f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:05.072457 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:05.073519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:05.074456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 303/612] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:05.075038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.084470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.107467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.108669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.109369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.109730 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.120890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.122389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.128881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:05.139295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:05.140477 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:05.141645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:05.141645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:05.141645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:05.141645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 310/613] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:05.141645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.182659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56a126-8d68-4a13-8ef6-2a734809af44 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.215552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.216163 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.216439 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.216711 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.217476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=0d23523367ac4aaf8768b750ad23e02b) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:05.217787 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.219279 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.225583 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 304/614] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/role_assignments?user.id=0d23523367ac4aaf8768b750ad23e02b&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:05.226206 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.267995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2af10-3539-4274-99f5-5a6cd502c330 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.306657 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.307451 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.307740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.308145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.308797 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:05.309103 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.310584 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.329940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 311/615] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:05.329940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.344032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88cb31-d3df-40db-86cb-e3ff5abd45fb None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.359372 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.361285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.384033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.384666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.384947 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.385284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.386026 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:05.386332 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.387820 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.409276 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 305/616] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:05.409899 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.444865 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b1b4f-8864-4d1a-b9bb-a36ef5fc9697 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.492763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.493419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.493697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.493971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.494620 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:05.494925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.496310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.508233 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 312/617] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:05.508895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.539775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006eb8e-82c7-4e44-b065-695d937512c1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.582058 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.582700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.582975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.583241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.590702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.592173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.603678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:05.605330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:05.606231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:05.607150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 306/618] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:05.608628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.624646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5116-ea4a-49a1-8350-1962ac5e924c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.643249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.659331 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.659944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.660221 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.660495 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.718220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab9dc-9684-4c6e-89a4-f267e0b80192 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.730867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.732505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.757354 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.758000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.758280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.758553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.766405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.768155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:05.779412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:05.780475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:58:05.781552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:05.785527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 307/619] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:05.785527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.830347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.853218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 313/620] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:58:05.853218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.892096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:05.902551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2f6c7-40a1-4e9d-a782-8047ca92a4f5 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.939727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.940346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.940627 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.940904 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.942124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:05.942438 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.944059 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:05.953314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efe3d0-1e52-401f-b30d-db7768a62331 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:05.963096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 308/621] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:05.968464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:05.994251 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:05.994975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:05.995257 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:05.995523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:05.996246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:05.996547 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:05.998014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.017468 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 314/622] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:06.018532 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.067072 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.085685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4c1e-92bb-40ab-b032-597fb037d946 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.122097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.122732 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.123012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.123286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.130951 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27221f-8cb6-42b8-a5af-7439c53dbcbf None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.134040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.135523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:06.153447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:06.154441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:06.155323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:06.155323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:06.155323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:06.155323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 309/623] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:06.155323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.158141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.181073 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.181821 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.182162 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.182439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.254343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.256092 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.267547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606db0-6c49-427b-983a-c0955ac4df54 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.303562 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.310342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.310956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.311235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.311507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.365700 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 315/624] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:58:06.366932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.392200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.393776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.396472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.472680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b82e6b-0d89-4ea6-9231-bcd2abbcf9b2 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.507618 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 310/625] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:58:06.508808 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.513507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.514129 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.514406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.514679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.515348 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:06.515650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.517117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.533873 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 316/626] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:06.533873 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.538681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.630678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226e6c-603c-4456-aa5e-60e773ea5d3d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.632470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.641072 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063bb99-f9cd-44ec-b4bc-025318bac02d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.668342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.668976 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.669282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.669555 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.677133 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.677795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.678073 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.678347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.680618 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.682202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.689510 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.690958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:06.697460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:06.698421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:06.699319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:06.699319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:06.699319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:06.699319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 311/627] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:06.699319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:06.709972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:06.710962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:06.711872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:06.711872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:06.711872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:06.714263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 317/628] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:06.715748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.777373 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.813791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a87c12-5d72-4bb0-85cf-857cb2c60b6f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.830173 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bb9f-6f3f-485c-b7de-42bded726387 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:06.850006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.850640 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.850918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.851193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.858490 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.860065 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.866721 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:06.867343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:06.867622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:06.867895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:06.868543 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:06.868861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:06.870281 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:06.872154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:06.873037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 312/629] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:06.879310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.882813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 318/630] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:06.883517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:06.901412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:06.997758 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa322-bcab-4c2d-a5a1-8fe73fc05035 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.000228 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c033192-c64a-49dc-9a9b-e003bcfe79ee None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.018164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:07.038678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.039196 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.039472 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.039736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.040421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.040716 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.042171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.042734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.043791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.044273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.045159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.046382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.046923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.048474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.054707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 319/631] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:07.055333 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.065949 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 313/632] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:07.067056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.152644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:07.170400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3626de-bf27-42df-abc8-433092110ec3 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.183604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecfb76-bf6c-478a-801b-686d51b2a244 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.209930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.210814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.211235 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.211756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.216702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.217341 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.217620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.217889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.218653 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=4b0911dbafa3421baea46c2cf923a516) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.218964 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.219890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.220399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.221919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.226289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 314/633] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/role_assignments?user.id=4b0911dbafa3421baea46c2cf923a516&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:07.227132 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:07.240996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:07.242202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:07.243311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:07.247118 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 320/634] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:07.248097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.292489 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:07.377620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334845-2207-4cb7-bdd4-2c6beca42726 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.390539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa33c-833b-4d9f-a5a5-6a35cf55af0d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.432338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.433370 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.433840 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.434113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.435396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.436282 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.436750 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.437346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.438049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.438355 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.439809 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.443182 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.444665 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.446622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:07.456606 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 321/635] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:07.459507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:07.460364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:07.461681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 315/636] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:07.463090 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.469577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.586747 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:07.594279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405eaf1-365c-4b58-b6c3-43a80f45200c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.595413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eadb5-5094-46df-a1cc-985334508dae None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.631076 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.631291 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.631678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.631796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.631949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.632040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.632214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.632317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.632898 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.632992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=2800cc436ad94811b4e938ee81124b8b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.633245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.633352 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.634759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563effa-e16d-4637-8a5b-de749e86acdb None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.634869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.645210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 322/637] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/role_assignments?user.id=2800cc436ad94811b4e938ee81124b8b&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:07.645210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997201-f598-4e65-86a2-8e0c7bca39f4 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.645210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997201-f598-4e65-86a2-8e0c7bca39f4 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.645210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997201-f598-4e65-86a2-8e0c7bca39f4 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.645210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 323/638] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:07.649764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.650036 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.650306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.664027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 316/639] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:07.665419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:07.678718 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:07.679964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:07.759003 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:07.765415 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 324/640] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:58:07.798232 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609320-4ba4-4cf9-a0fc-81f4c0147d36 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:07.836281 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:07.837260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:07.837754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:07.838027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:07.838761 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=2c40b1bbc4994db9a5c7a40c504a659a) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:07.839071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:07.840513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:07.848786 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 317/641] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:58:07 2022] GET /identity/v3/role_assignments?user.id=2c40b1bbc4994db9a5c7a40c504a659a&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:08.098777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:08.197762 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:08.207836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed248b-0ecb-4552-82e6-afe0b38b565a None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:08.245136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:08.245809 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:08.246088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:08.246362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:08.257649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:08.262754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:08.263748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:08.264652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 325/642] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:08.274746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:08.385596 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd45a-6f31-4e9e-8cca-ff57f5654617 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:08.409571 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:08.422188 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:08.423052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:08.423532 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:08.423990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:08.424825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:08.425331 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:08.426909 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:08.438707 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 318/643] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:08.444054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:08.549370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245b94-dc4d-432e-bdb1-d7ebc9f6419d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:08.583769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:08.584452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:08.584735 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:08.585007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:08.597375 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:08.598929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:08.614677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:08.615689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:08.616588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:08.616588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:08.616588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:08.616588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 326/644] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:58:08.621756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:08.727771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49505ed6-864a-4f04-8eda-108731b0923b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:08.762185 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:08.762795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:08.763071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:08.763340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:08.764034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:08.764337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:08.765770 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:08.778011 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 319/645] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:08.783487 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:08.786758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:08.895933 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de933e6-950b-42a8-bfb3-e54fcd20cf54 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:08.931612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:08.932552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:08.933015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:08.933486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:08.941822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:08.943520 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:08.955987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:08.956982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:08.957990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:08.960211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 327/646] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Aug 22 13:58:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:08.965999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:09.022527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:09.075657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8721-0544-4ab4-a2d1-703c58c52bb7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:09.113444 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:09.114064 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.114347 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.114620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.115357 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:09.115661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:09.117121 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:09.137074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 320/647] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Aug 22 13:58:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:09.146309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:09.212780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:09.254824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4b465-2c9e-4be8-b70f-2a8fd2d8c47e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:09.290418 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d3d64-14fc-44be-96a3-a23f61412582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:09.290953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d3d64-14fc-44be-96a3-a23f61412582 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.291231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d3d64-14fc-44be-96a3-a23f61412582 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.291500 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d3d64-14fc-44be-96a3-a23f61412582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.362479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d3d64-14fc-44be-96a3-a23f61412582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:09.363949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d3d64-14fc-44be-96a3-a23f61412582 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:09.430988 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:09.476262 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 328/648] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 13:58:09.486348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:09.574193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a942f8-ccb9-4050-a992-3f54fb80df20 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.574823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a942f8-ccb9-4050-a992-3f54fb80df20 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.575291 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a942f8-ccb9-4050-a992-3f54fb80df20 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.577368 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 329/649] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:09.582432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.582932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.583528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.599964 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc055-dff7-4d12-9b33-e2fc4947c6e1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:09.601673 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:09.608328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:09.612116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:09.643302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:09.644216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.644669 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.645107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.656021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:09.657555 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:09.673355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:09.674644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:09.675539 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:09.675539 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:09.675539 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:09.679256 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 321/650] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:09.680556 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:09.707559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 330/651] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:09.794096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bef78-dd09-471f-a610-e8df425c889e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:09.838149 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:09.838940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.839289 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.839638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.840563 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:09.840947 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:09.842642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f807018-ee7f-498e-8beb-ca754878ee33 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:09.860926 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 322/652] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:09.862606 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:09.962148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:09.971156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec897d11-b39c-45d4-8f22-41f882527fae None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:09.975142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f6a9b-8f75-48d3-bd26-688babbaab8f None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.975424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f6a9b-8f75-48d3-bd26-688babbaab8f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.975697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f6a9b-8f75-48d3-bd26-688babbaab8f None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:09.977205 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 323/653] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:09.981973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:09.982250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:09.982515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.003222 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:10.004417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:10.015191 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:10.028469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.030851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.031372 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.031869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.041843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.043316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:10.055427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:10.056367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 331/654] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:10.057340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.097487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 324/655] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:58:10.097487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.201276 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4352d3-e9a8-408a-8d2c-ff1b50bf0e59 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.209687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97261252-0b69-4227-8fa1-69d6ebb2b551 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.242214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.242870 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.243254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.243590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] PATH_INFO: `/v3/services/image` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.244280 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.245829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.254952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.255839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.256293 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.256751 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:10.257419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:10.258473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.259777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 332/656] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:10.261051 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:10.261401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.263535 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b76ae-4fc2-4083-94af-541de0b3504c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.264274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.282352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 325/657] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:10.287453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:10.288578 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b51d2-c747-469c-92a6-59b9074db28b None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.288979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b51d2-c747-469c-92a6-59b9074db28b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.289134 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b51d2-c747-469c-92a6-59b9074db28b None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.290582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 326/658] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:10.291143 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b51d2-c747-469c-92a6-59b9074db28b None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.299453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:10.379208 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8aa5-6cc8-4af8-a049-7f70769530cd None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.404103 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b51d2-c747-469c-92a6-59b9074db28b None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.413916 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.414524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.414796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.415066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.415689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] RBAC: Adding query filter params (name=image) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:10.415988 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.417411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545323d-8b1f-4364-a383-4f254fd87295 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.426452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 333/659] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:10.426452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.426452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.426452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.442031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:10.443256 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:10.444229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.444839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.445118 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.445418 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.446138 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=0d23523367ac4aaf8768b750ad23e02b) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:10.446444 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.447885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.453243 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 327/660] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/role_assignments?user.id=0d23523367ac4aaf8768b750ad23e02b&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:10.454025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.528076 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 334/661] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:10.528841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.534003 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:10.542714 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:10.587481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a43a-7f1d-45e4-890d-5629c29d2ce9 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.631950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.632540 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.632842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.633201 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.633864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] RBAC: Adding query filter params (type=image) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:10.634188 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.635643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.648427 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 328/662] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:10.671137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74fdab-3b75-4c86-ab62-078c72c30500 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.714691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.715651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.716088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.716497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] PATH_INFO: `/v3/services/network` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.717320 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.719065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:10.729364 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:10.730624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:10.731647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:10.734510 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 335/663] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:10.740835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.858937 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e308e3-ea07-4d01-9f20-961e7fee3a4c None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:10.862816 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.897775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:10.907559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:10.908459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:10.908823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:10.909251 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:10.910161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] RBAC: Adding query filter params (name=network) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:10.910780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:10.912554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:10.918115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 329/664] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:10.925858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:10.975199 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:11.012253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff6cae-49ba-4ee4-891b-ac7f111cd185 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:11.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d185d0-7dc7-49fd-8bf4-043c27d144bc None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:11.059625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:11.060840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:11.061497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:11.061780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:11.062614 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:11.063967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:11.075959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:11.076954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:11.082069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 336/665] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:58:11.084112 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:11.088590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:11.089261 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:11.089546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:11.089819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:11.091105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] RBAC: Adding query filter params (type=network) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:11.091105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:11.092228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:11.101468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 330/666] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:11.209390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64791d-756d-4335-8ed0-7a91a68fbb8d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:11.250377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:11.251857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:11.252331 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:11.252896 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:11.253931 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:11.254432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:11.256017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7643-1ce8-43a8-aa1d-414d7160bbb1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:11.261999 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 337/667] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Aug 22 13:58:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:11.268642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:11.335388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:11.380429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c6d9-2b73-49c0-8151-bfbc71631e55 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:11.416122 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:11.417149 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:11.417702 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:11.418164 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:11.419039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:11.419528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:11.421585 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dbaef-bbd3-491f-8280-a78f53ae5d6f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:11.426766 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 331/668] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Aug 22 13:58:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:12.794259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce08b-97a6-4ade-9692-5d338cba7044 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:12.794802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce08b-97a6-4ade-9692-5d338cba7044 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:12.794802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce08b-97a6-4ade-9692-5d338cba7044 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:12.796888 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 338/669] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:12.802473 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:12.802902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:12.803075 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:12.821868 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:12.822989 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:12.861679 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9922bfd-c512-459c-937d-f4c43168c22b None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:12.862005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9922bfd-c512-459c-937d-f4c43168c22b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:12.862216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9922bfd-c512-459c-937d-f4c43168c22b None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:12.863668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 339/670] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:12.868605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:12.868880 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:12.869150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:12.876152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:12.890110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:12.891318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:12.906850 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 332/671] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:12.960799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 340/672] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:58:13.235958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:13.286707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:13.297734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:13.358650 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86478fa-8018-4e16-9d9e-8747e1b3cc37 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:13.390901 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8bca5-d6c4-48c7-88ad-53b5885e8d41 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:13.395851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ba006-d8a5-41d9-a1b3-d426ff6b80e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:13.396493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba006-d8a5-41d9-a1b3-d426ff6b80e2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.396772 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba006-d8a5-41d9-a1b3-d426ff6b80e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.397029 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba006-d8a5-41d9-a1b3-d426ff6b80e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.407729 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ba006-d8a5-41d9-a1b3-d426ff6b80e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-de9ba006-d8a5-41d9-a1b3-d426ff6b80e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:13.412449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:13.413404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:13.414240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 333/673] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:13.415478 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23eec1-d228-4ac8-970f-f0ef30e6bf2f None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.415478 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23eec1-d228-4ac8-970f-f0ef30e6bf2f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.415723 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23eec1-d228-4ac8-970f-f0ef30e6bf2f None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.417073 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 334/674] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:13.422248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23eec1-d228-4ac8-970f-f0ef30e6bf2f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:13.430553 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:13.436555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b0fab-ecdc-4cf1-bfd8-8a686ba6c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:13.437563 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0fab-ecdc-4cf1-bfd8-8a686ba6c563 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.437849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0fab-ecdc-4cf1-bfd8-8a686ba6c563 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.438130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0fab-ecdc-4cf1-bfd8-8a686ba6c563 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.438795 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b0fab-ecdc-4cf1-bfd8-8a686ba6c563 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:13.440185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b0fab-ecdc-4cf1-bfd8-8a686ba6c563 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:13.459100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 341/675] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:58:13 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:13.460501 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57837819-d477-4ce8-95f4-0f541660009e None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.460794 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57837819-d477-4ce8-95f4-0f541660009e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.461070 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57837819-d477-4ce8-95f4-0f541660009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.482560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-57837819-d477-4ce8-95f4-0f541660009e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:13.483991 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-57837819-d477-4ce8-95f4-0f541660009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:13.578864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23eec1-d228-4ac8-970f-f0ef30e6bf2f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:13.585973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 342/676] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:13 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 13:58:13.601617 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:13.623889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:13.624801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.625307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.625712 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.626661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:13.627125 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:13.628691 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:13.639317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 335/677] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:13.649374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9446709-df59-44d0-b401-3d4bf1cfeabe None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.649374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9446709-df59-44d0-b401-3d4bf1cfeabe None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.649374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9446709-df59-44d0-b401-3d4bf1cfeabe None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.649374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 343/678] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:13.649782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:13.649857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.649857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.649992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.669806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:13.671479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:13.760588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 344/679] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:13 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 13:58:13.769421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db4cf-b3d5-42c6-9bc6-8d71559464d7 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:13.804476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:13.805100 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:13.805413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:13.805697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:13.817284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:13.818698 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:13.833748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:13.834797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:13.835741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:13.835741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:13.835741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:13.835741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 336/680] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:13.842435 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:13.919874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:13.957777 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:14.035907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:14.057541 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b749-ea2a-490c-ad32-de00463617bb None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.093558 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.094093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.094382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.094648 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.095309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.096323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe825-e5c1-47d5-8d73-fd3d82768569 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.096789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.115248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 337/681] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:58:13 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:58:14.116227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:14.145052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.145748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.149594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.149594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.150315 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:14.150623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.152073 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.169622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 345/682] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:14.172172 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:14.253665 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:14.262327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65085c9c-294c-404e-baab-c168e93b825f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.304389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.305025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.305337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.305612 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.306333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.307492 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429302a-2a07-4e4b-9a35-d6f2ec9df136 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.307728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.310160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:14.328081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 338/683] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:58:14 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:14.363232 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.364008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.364376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.364744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.376135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.377652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:14.391772 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:14.393057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:14.394288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:14.396797 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 346/684] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Aug 22 13:58:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:14.406505 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:14.529070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a49a-9bd8-41bf-bc51-8817e863cdc3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.573672 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.574298 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.574579 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.574860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.575602 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:14.575909 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.579566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.597333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 339/685] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Aug 22 13:58:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:14.602913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:14.711649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced08fde-8da4-4467-8ed4-6f7994a7a635 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.746269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.746907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.747193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.747467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.758735 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.760202 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:14.775095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:14.776086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:14.777835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:14.777835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:14.777835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:14.777835 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 347/686] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:14.782378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:14.791642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:14.889783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa73f7-3088-4c45-927f-59ca3e116652 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:14.926416 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:14.927273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:14.927699 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:14.928116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:14.928895 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:14.929390 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:14.930913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:14.943519 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 340/687] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:14.949028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:14.965374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:15.053966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23fc1-d56c-4266-a678-b346c4a58dd8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:15.089017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:15.089877 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:15.090257 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:15.090627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:15.097773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:15.099459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:15.112231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:15.113157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:15.114378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 348/688] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:15.119697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:15.193483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:15.230870 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89fbb-4cbc-4d16-93a9-1f7ebc11fcc2 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:15.266690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:15.267423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:15.267743 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:15.268016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:15.268719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:15.269028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:15.270499 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e842c-422a-413c-bb56-4581e6aefd8c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:15.283479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 341/689] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:15.289152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:15.365649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:15.405940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d11278-df49-4cd8-9bbb-fbbd89a528f9 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:15.445070 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53b5f-bfa9-449e-8e8e-fbb39cc8e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:15.445814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53b5f-bfa9-449e-8e8e-fbb39cc8e22d None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:15.446088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53b5f-bfa9-449e-8e8e-fbb39cc8e22d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:15.446351 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53b5f-bfa9-449e-8e8e-fbb39cc8e22d None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/0d23523367ac4aaf8768b750ad23e02b/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:15.448564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53b5f-bfa9-449e-8e8e-fbb39cc8e22d None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=0d23523367ac4aaf8768b750ad23e02b, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:15.450113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53b5f-bfa9-449e-8e8e-fbb39cc8e22d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:15.467499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 349/690] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:58:15 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/0d23523367ac4aaf8768b750ad23e02b/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:58:15.804108 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e746-57b2-4524-b02b-49fbf2eb2f39 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:15.804499 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e746-57b2-4524-b02b-49fbf2eb2f39 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:15.804685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e746-57b2-4524-b02b-49fbf2eb2f39 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:15.806249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 342/691] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:15.811791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:15.812027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:15.812303 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:15.830614 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:15.831799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:15.897919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 350/692] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:16.217756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56e746-57b2-4524-b02b-49fbf2eb2f39 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:16.333308 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56e746-57b2-4524-b02b-49fbf2eb2f39 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:16.369614 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:16.370621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:16.371097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.371557 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.372006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] PATH_INFO: `/v3/services/image` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.372855 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:16.374680 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-3c1c2f6e-324d-465d-8fca-e557d9d4939d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:16.390823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:16.392661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:16.394305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:16.396978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 343/693] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Aug 22 13:58:16 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:16.402738 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:16.415686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d056-a230-4b0f-bad6-0e604747fbcc None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.415969 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d056-a230-4b0f-bad6-0e604747fbcc None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.416249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d056-a230-4b0f-bad6-0e604747fbcc None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.417873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 344/694] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:16.423871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.424154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.424431 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.445884 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:16.447082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:16.473675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:16.520069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1d21f-b062-4480-9824-9238ae73c83b None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:16.537295 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 345/695] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:16 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:16.564110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:16.565018 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.565551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.566065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.566885 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] RBAC: Adding query filter params (name=image) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:16.567380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:16.568925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:16.574228 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 351/696] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:16.580151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:16.691087 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c849b95-d69f-4314-8047-fb68464a2a87 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:16.712067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:16.727077 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:16.727621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.727903 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.728178 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.728813 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] RBAC: Adding query filter params (type=image) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:16.729119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:16.730517 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7de2f-b4ee-4a2b-86a8-54d459cb3078 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:16.736186 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 346/697] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:16.742081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:16.838843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88908c-d42e-40f4-ba4a-50920f797edb None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.839193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88908c-d42e-40f4-ba4a-50920f797edb None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.839401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88908c-d42e-40f4-ba4a-50920f797edb None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.842194 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 347/698] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:16.846559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.846792 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.847070 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.852745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3c08-7464-4e7b-9bcf-e70ef63666ca None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:16.865893 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:16.867228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:16.880423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:16.889691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:16.890380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:16.890683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:16.890955 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:16.891781 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] RBAC: Adding query filter params (interface=public, service_id=8d537c6ea4ca477c82b2c8068be652f0, region_id=RegionOne) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:16.891956 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:16.893354 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:16.901290 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 352/699] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 13:58:16 2022] GET /identity/v3/endpoints?service_id=8d537c6ea4ca477c82b2c8068be652f0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:16.901534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:16.942239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 348/700] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:16 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:16.943781 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.015362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271313f5-574c-4dc7-b086-a6de2ebf5607 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.063526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.064557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.065034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.065529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.066869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.069016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.080546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6557-c583-49a5-89df-a168713fa91a None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:17.082862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:17.083841 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:17.084665 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:17.086997 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 353/701] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:16 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:17.094703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.102912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:17.127928 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.128535 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.128856 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.129325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.130538 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.132965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.141228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 349/702] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 13:58:16 2022] GET /identity/v3/services => generated 1002 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 13:58:17.177561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:17.233338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb17e3c-3855-405f-861c-2b5e1b0464f2 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.275681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.276654 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.277157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.277686 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.278520 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] RBAC: Adding query filter params (name=network) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:17.279017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.280848 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.287514 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 354/703] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:17.297245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.303576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.415057 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6334b-c1e5-41a2-b0ea-00e54b2ad388 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.423653 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05dae4-f066-4b37-835a-41cb7c3e3afe None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.450597 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:17.455764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.456440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.456726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.457001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.457709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] RBAC: Adding query filter params (type=network) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:17.458018 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.459529 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.470600 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 350/704] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:17.472417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.476167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.476826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.477105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.477421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.478682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.479493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:17.488996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:17.490093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:17.491413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 355/705] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:58:17.509240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.536041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:17.629740 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130af0b-5a52-4fd0-be88-a1f30909961e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.640512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19a42-2de5-44c3-91b6-c00bca224f11 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.667073 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.667976 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.668088 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.668392 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.669165 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] RBAC: Adding query filter params (interface=public, service_id=44d52bbb55144d2484eb4fcabfd46591, region_id=RegionOne) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:17.669564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.671466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.680585 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.681469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.681928 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.682428 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.682544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 351/706] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/endpoints?service_id=44d52bbb55144d2484eb4fcabfd46591&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:17.683367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:17.683747 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.689244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.689401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.698907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 356/707] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:17.700499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.767237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:17.812832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab369711-4bd7-4310-a07d-a2e1df5ef491 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.821668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad241bf3-54a2-4f08-a35c-8c1bed1d103d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:17.822525 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:17.857063 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.857504 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e382-d0d5-45ef-9a81-dc555da30f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:17.857882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.858109 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e382-d0d5-45ef-9a81-dc555da30f79 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.858214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.858390 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e382-d0d5-45ef-9a81-dc555da30f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.858564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.858705 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e382-d0d5-45ef-9a81-dc555da30f79 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.859291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0e382-d0d5-45ef-9a81-dc555da30f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.859390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:17.859700 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:17.860855 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0e382-d0d5-45ef-9a81-dc555da30f79 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.861803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:17.872673 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 352/708] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 13:58:17.872960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 357/709] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:17.873082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd7f79-b7dc-4f9f-99e0-b2dbee28eb33 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.873082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd7f79-b7dc-4f9f-99e0-b2dbee28eb33 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.873082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd7f79-b7dc-4f9f-99e0-b2dbee28eb33 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.873082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 353/710] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:17.874014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:17.878752 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:17.879029 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:17.879286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:17.899940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:17.901326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:17.993760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 354/711] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:18.019356 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd597ca-fcc6-441f-a74c-805df7fdb77b None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:18.033011 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:18.061892 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:18.062530 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:18.062806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:18.063127 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:18.063778 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] RBAC: Adding query filter params (interface=public, service_id=004ea12dabfc40c396c50963d2ce51c1, region_id=RegionOne) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:18.064083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:18.065503 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:18.071890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 358/712] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 13:58:17 2022] GET /identity/v3/endpoints?service_id=004ea12dabfc40c396c50963d2ce51c1&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:18.078661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:18.182433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:18.186066 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c77f4-d161-4321-a533-e15c729f1b76 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:18.226575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:18.227580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:18.228067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:18.228532 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:18.229382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:18.231018 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:18.238004 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 355/713] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 13:58:18 2022] GET /identity/v3/services => generated 1002 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 13:58:18.341133 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:18.456874 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b10ca2-ffe9-4134-b695-ad70b0aecfb8 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:18.492994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:18.493726 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:18.494004 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:18.494273 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:18.507650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:58:18.513518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:18.514499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:18.515401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 359/714] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 13:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:18.521512 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:18.627606 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e8ee-9d60-4899-8931-87ada8f459bc None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:18.663725 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:18.664337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:18.664613 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:18.664885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:18.665596 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:18.665897 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:18.667291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:18.677137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 356/715] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:18.682535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:18.717284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:18.785560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41944533-14bd-4094-a96e-66b2074ba2f9 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:18.825117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:18.825783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:18.826055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:18.826321 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:18.837922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:18.839376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:18.853801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:18.854753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:18.855649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:18.855649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:18.855649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:18.855649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 360/716] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:18.861321 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:18.889880 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:18.963113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fa075-9841-4f38-96c2-b3a0b1503d25 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:18.997167 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:18.997799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:18.998074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:18.998349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:18.998998 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:18.999325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:19.000867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:19.015112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 357/717] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:19.020675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:19.111803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:19.126697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153e9ac-cb90-44ff-9c56-30c566976c49 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:19.174568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:19.175225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:19.175492 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:19.175761 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:19.185498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:19.187017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:19.199454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:19.200445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:19.201448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 361/718] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Aug 22 13:58:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:19.207633 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:19.303314 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:19.319045 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fdf17-631f-4d1f-95ff-c51587c40e8f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:19.356159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:19.356786 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:19.357062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:19.357368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:19.358119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:19.358420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:19.360102 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9db6eb-c3f4-450e-9053-31df9ce46572 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:19.380615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 358/719] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Aug 22 13:58:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:19.386361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:19.487250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d9fa-26b4-407d-a4e8-7994e6bf7400 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:19.519202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460dc1-ff9c-4b43-9079-4b1687f097e1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:19.519520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460dc1-ff9c-4b43-9079-4b1687f097e1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:19.519889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460dc1-ff9c-4b43-9079-4b1687f097e1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:19.521513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 359/720] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:19.523892 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:19.524541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:19.524815 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:19.525081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:19.528900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:19.529421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:19.529498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:19.545890 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:19.557673 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:19.559822 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:19.598216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:19.599764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:19.649487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 360/721] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:19.711633 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 362/722] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:19 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 13:58:19.717246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:19.795917 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:19.824046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b84e57-3b96-40cc-b9a7-cb6f266796cf None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:19.858798 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:19.859439 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:19.859714 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:19.859992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:19.870673 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:19.872191 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:19.887249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:19.888226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:19.889127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:19.889127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:19.889127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:19.889127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 361/723] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:19.894197 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:19.942799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.001133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.001491 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272968-6a9c-4e9c-9941-e78a7d186557 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.038681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.040519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.040519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.040519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.041006 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:20.041006 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.045529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.056007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 363/724] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:20.061087 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.119669 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b9bd7-bb36-4eac-aa5a-5dd1e9fe2245 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.159630 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.171612 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.172615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.172960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.173330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.174247 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.176142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.188056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474f242-325f-4a10-b6ff-43a861cff189 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:20.189622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:20.191544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:20.192575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 362/725] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:20.197251 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.201209 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.237936 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.238577 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.238855 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.239125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.248213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.249996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:20.264977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:20.267385 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:20.269966 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 364/726] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:20.274401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.315602 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92c05-df75-4f7c-8cdc-bff2150812b0 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.350626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.351232 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.351506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.351772 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.352388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] RBAC: Adding query filter params (name=image) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:20.352686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.354101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70f4e-f46b-4397-8d00-74c3866db1ec None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.360126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 363/727] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:20.361440 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac51b-848d-4c11-bf9c-39cdc4f04cd4 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.361718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac51b-848d-4c11-bf9c-39cdc4f04cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.361989 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac51b-848d-4c11-bf9c-39cdc4f04cd4 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.363385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 364/728] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:20.366097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac51b-848d-4c11-bf9c-39cdc4f04cd4 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.390072 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d2778-b161-4a9a-b48b-69b47067cd35 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.426348 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.426961 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.427238 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.427508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.428200 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:20.428502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.429979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da569f8-d604-4fcd-9dcb-35f8923cb4c3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.432098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.442048 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 365/729] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:20.443277 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.443557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.443827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.461067 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:20.462297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:20.484065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.488238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac51b-848d-4c11-bf9c-39cdc4f04cd4 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.531742 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.533199 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.533487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.533761 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.534401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:20.534700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.536117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.549167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 366/730] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:20.549167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.549747 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 365/731] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:20.549747 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.673530 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7783ef-7a79-4ed8-81ec-96105884c4a1 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.675846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d699e-8662-4792-b340-86abee50fad3 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:20.694257 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.710758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.711371 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.711650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.711911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.712266 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:20.712632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=0d23523367ac4aaf8768b750ad23e02b) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:20.712922 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.713016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.713235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.713522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.714177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:20.714484 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e407b-49d4-4c6e-8d74-a6fcd596487b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.715528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:20.720833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 367/732] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/role_assignments?user.id=0d23523367ac4aaf8768b750ad23e02b&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:20.722047 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3746480-4445-41c5-8641-12b369c85fa0 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.722329 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3746480-4445-41c5-8641-12b369c85fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.722600 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3746480-4445-41c5-8641-12b369c85fa0 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.723984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 368/733] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:20.729698 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:20.730028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:20.730429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:20.754072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 366/734] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 13:58:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:58:20.755553 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:20.756770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:20.774133 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:20.852988 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 369/735] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:20 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:20.872877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:20.991594 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8730a8-3b51-49ea-9de0-579d18627850 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.027099 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.027740 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.028016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.028280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] PATH_INFO: `/v3/services/network` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.028859 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.030310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:21.040052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:21.041311 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:21.042366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 367/736] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:20 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:21.048178 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.149669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50767-969f-4c86-9018-6b53adeee110 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.180842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.186674 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.187287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.187560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.187823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.188637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] RBAC: Adding query filter params (name=network) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:21.189013 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.190434 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.195668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 370/737] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:21.201117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.217143 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:21.225371 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:21.296483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885931a-5d63-4c50-b40c-a32e94272b14 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.324479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e8b6-7da4-443f-8590-a5e37f940ce0 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.333028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.333846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.334047 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.334344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.334941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.336638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:21.345961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:21.347007 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:21.353395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 368/738] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Aug 22 13:58:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:58:21.356310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.369449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.370507 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.370902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.371610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.372348 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] RBAC: Adding query filter params (type=network) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:21.373057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.374883 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.385261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 371/739] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:21.387660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.471103 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:21.495710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697feab-d2da-425c-9ecb-ecb07897e722 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.497458 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:21.497595 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca36bcb-7c66-42be-9503-d724668d9895 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.535600 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.536457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.536965 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.537117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.537854 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.539393 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.542268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.543545 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.543984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.544391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.545784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:21.546814 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.548832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.558992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 369/740] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Aug 22 13:58:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:21.560867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.576859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 372/741] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 13:58:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:58:21.688044 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca63860-8a80-425b-b40a-b5701aa4afe4 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.732383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.733027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.733413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.733693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.734385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:21.734689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.736113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d92f-51f6-4cc7-85c9-ea90cecfe671 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.742452 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 370/742] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Aug 22 13:58:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:21.750566 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:21.864900 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60e57-0943-472a-8562-3eef5d4e2bc4 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:21.896883 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:21.903763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65f1a-f9a1-45e3-a00f-c09a0adaeb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:21.904787 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65f1a-f9a1-45e3-a00f-c09a0adaeb54 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:21.905461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65f1a-f9a1-45e3-a00f-c09a0adaeb54 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:21.906098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65f1a-f9a1-45e3-a00f-c09a0adaeb54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:21.906761 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65f1a-f9a1-45e3-a00f-c09a0adaeb54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:21.908386 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65f1a-f9a1-45e3-a00f-c09a0adaeb54 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:21.936992 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 373/743] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 13:58:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:23.074338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8057c4a-c572-4180-9067-6c2f8a91dcf4 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.074913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8057c4a-c572-4180-9067-6c2f8a91dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.074913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8057c4a-c572-4180-9067-6c2f8a91dcf4 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.076275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 371/744] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:23.082228 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727225-e900-4141-8340-5c30af60acf7 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.082742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727225-e900-4141-8340-5c30af60acf7 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.082742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727225-e900-4141-8340-5c30af60acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.101708 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-10727225-e900-4141-8340-5c30af60acf7 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:23.102910 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-10727225-e900-4141-8340-5c30af60acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:23.165527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de04dc-eb64-4bf8-8201-496ba4b52737 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.165806 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de04dc-eb64-4bf8-8201-496ba4b52737 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.166078 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de04dc-eb64-4bf8-8201-496ba4b52737 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.167411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 372/745] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:23.172716 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.173021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.173332 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.182568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 374/746] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:23 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:23.191730 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:23.192931 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:23.214484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:23.276746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 373/747] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:23 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:23.508284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10727225-e900-4141-8340-5c30af60acf7 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:23.600291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:23.624230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10727225-e900-4141-8340-5c30af60acf7 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:23.639875 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:23.665193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:23.665836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.666115 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.666382 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.713062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f625d47-8e43-4cfe-a8b0-26dcbedf83a7 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:23.736039 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:23.737569 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:23.752100 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:23.753015 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.753330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.753603 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.754192 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:23.755934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:23.765510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:23.766520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:23.767406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 374/748] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Aug 22 13:58:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:23.773115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:23.798104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:23.845231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 375/749] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:58:23 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 13:58:23.849498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:23.864998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:23.880474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269aaeb-639c-43fb-9904-7e21fb0c8f27 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:23.916696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:23.917329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:23.917612 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:23.917887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:23.918521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:23.918827 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:23.920565 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:23.925378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 375/750] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Aug 22 13:58:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:23.931002 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:23.959846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defccc52-ab13-4ff1-9189-daa3bb161988 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:24.003673 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:24.004642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.005087 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.005390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.017327 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:24.018721 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:24.031323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:58:24.034942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:24.035985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:58:24.036881 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:58:24.036881 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:58:24.036881 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:24.036881 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 376/751] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:24.041954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:24.053385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddcd95-5656-441f-a443-a43c1d1bb96f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:24.088969 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:24.089671 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.089882 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.090157 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.090792 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:24.091097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:24.092480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5dabf-1b9a-4c36-a33a-218ea7e05aea None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:24.097415 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 376/752] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Aug 22 13:58:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:24.111852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:24.153234 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7398-09f4-47c3-848b-8a4681f0b721 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.153528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7398-09f4-47c3-848b-8a4681f0b721 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.153802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7398-09f4-47c3-848b-8a4681f0b721 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.155134 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 377/753] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:24.160001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a9d85-ad6b-445c-a9f6-6d5ff482b8cb None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:24.161291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.161576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.161871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.182017 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:24.183248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:24.203450 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:24.204075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.204350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.204617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.205311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:24.205645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:24.207001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:24.228087 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 377/754] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:24.270791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 378/755] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:24 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:24.595457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:24.696313 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd046ba-85ef-4f80-8813-3a0802b2743f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:24.720508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:24.732857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:24.733541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.733815 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.734079 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.734655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:24.736025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:24.744639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:24.745801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:24.747084 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:24.749443 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 378/756] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:24.751864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:24.844363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:24.866475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9b83-9d89-4fdb-822d-e44c2742293e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:24.901741 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:24.902363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:24.902639 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:24.903151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:24.903791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:24.904098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:24.905528 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d264f-9abd-4146-948d-bb5766cfb5da None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:24.910405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 379/757] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:24.916225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:25.023309 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2887c-59c2-4863-803b-12b26e9838d2 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:25.059354 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:25.059962 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:25.060240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:25.060509 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:25.061143 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:25.061544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:25.062929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161784-afa9-46fa-acaa-b29b2c07bc8e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:25.067678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 379/758] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:26.302852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb25ce-3637-4742-a3c0-c06fe92e7de4 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:26.303419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb25ce-3637-4742-a3c0-c06fe92e7de4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:26.303419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb25ce-3637-4742-a3c0-c06fe92e7de4 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:26.304804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 380/759] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:26.310327 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3253a87-d22f-4af7-9628-fbe8ab523a7f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:26.310727 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3253a87-d22f-4af7-9628-fbe8ab523a7f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:26.310872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3253a87-d22f-4af7-9628-fbe8ab523a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:26.330374 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c3253a87-d22f-4af7-9628-fbe8ab523a7f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:26.331560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c3253a87-d22f-4af7-9628-fbe8ab523a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:26.380777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:26.401769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 380/760] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:26.719084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb25ce-3637-4742-a3c0-c06fe92e7de4 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:26.840991 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb25ce-3637-4742-a3c0-c06fe92e7de4 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:26.881323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b23b3-ef18-46ec-9aac-85ed6b947fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:26.881926 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b23b3-ef18-46ec-9aac-85ed6b947fcc None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:26.882204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b23b3-ef18-46ec-9aac-85ed6b947fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:26.882477 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b23b3-ef18-46ec-9aac-85ed6b947fcc None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:26.883113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b23b3-ef18-46ec-9aac-85ed6b947fcc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:26.884495 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b23b3-ef18-46ec-9aac-85ed6b947fcc None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:26.900186 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 381/761] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:58:26 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:27.253857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eb94d-3a67-4abc-bcb8-7a9f424793b9 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:27.254192 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eb94d-3a67-4abc-bcb8-7a9f424793b9 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:27.254392 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eb94d-3a67-4abc-bcb8-7a9f424793b9 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:27.255741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 381/762] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:27.261373 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120805c-1ce6-4b9b-bb30-0dfb7dc75a1f None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:27.261675 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120805c-1ce6-4b9b-bb30-0dfb7dc75a1f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:27.261953 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120805c-1ce6-4b9b-bb30-0dfb7dc75a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:27.268819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:27.282141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b120805c-1ce6-4b9b-bb30-0dfb7dc75a1f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:27.283347 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b120805c-1ce6-4b9b-bb30-0dfb7dc75a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:27.360909 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 382/763] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:27 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:27.684266 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eb94d-3a67-4abc-bcb8-7a9f424793b9 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:27.791430 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eb94d-3a67-4abc-bcb8-7a9f424793b9 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:27.827911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26e305-af50-4193-bced-ea6fc2f11a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:27.829122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e305-af50-4193-bced-ea6fc2f11a2d None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:27.829122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e305-af50-4193-bced-ea6fc2f11a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:27.829122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e305-af50-4193-bced-ea6fc2f11a2d None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:27.829632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e305-af50-4193-bced-ea6fc2f11a2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:27.831000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e305-af50-4193-bced-ea6fc2f11a2d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:27.847331 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 382/764] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:58:27 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:29.099335 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1dfab-2f37-4ab1-95b7-e819851af704 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:29.099924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1dfab-2f37-4ab1-95b7-e819851af704 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:29.099924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1dfab-2f37-4ab1-95b7-e819851af704 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:29.101212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 383/765] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:29.106596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:29.107042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:29.107131 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:29.126011 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:29.127182 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:29.162862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:29.202091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 383/766] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:29.519604 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1dfab-2f37-4ab1-95b7-e819851af704 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:29.627200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1dfab-2f37-4ab1-95b7-e819851af704 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:29.654910 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:29.663408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:29.664043 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:29.664323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:29.664590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:29.665176 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:29.666577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:29.675507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:29.676608 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:29.677620 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 384/767] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Aug 22 13:58:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:29.682660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:29.791622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e27c-a78a-4932-8bcf-c59aaae63a1d None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:29.826323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:29.826975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:29.827287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:29.827472 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:29.828193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:29.828432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:29.829847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:29.834555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 384/768] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Aug 22 13:58:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:29.840376 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:29.961591 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58777c-aed7-4191-b548-181496912c8d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:29.997165 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:29.997791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:29.998069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:29.998330 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:29.999042 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:29.999345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:30.000720 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d12c-a31d-4828-b9bc-4e9ee446769a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:30.005972 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 385/769] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Aug 22 13:58:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:30.012106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:30.040754 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05e10-8fc2-4198-a92a-dae0700cefca None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.041033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05e10-8fc2-4198-a92a-dae0700cefca None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.041349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05e10-8fc2-4198-a92a-dae0700cefca None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.042950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 386/770] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:30.048327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.048607 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.048886 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.049029 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:30.067473 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:30.068666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:30.122291 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:30.125831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ac32-09fd-48db-bc3c-a1d81ef16e89 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:30.140687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 387/771] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:30.160416 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:30.161032 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.161343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.161617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.162320 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] RBAC: Adding query filter params (interface=public, service_id=ece29afc20ae474996c3851fee9283d1, region_id=RegionOne) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:30.162631 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:30.164016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:30.168939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 385/772] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 13:58:30 2022] GET /identity/v3/endpoints?service_id=ece29afc20ae474996c3851fee9283d1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:30.175191 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:30.275690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665170ae-0f17-4d47-8176-89d926cc321e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:30.314174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:30.314690 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.314964 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.315231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.315827 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:30.317214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:30.323150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 388/773] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 13:58:30 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 13:58:30.476284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:30.584117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:30.591723 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da82ee-2d2b-492a-9edf-3ed64ca1d708 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:30.633499 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:30.634178 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.634456 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.634723 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.635302 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:30.636668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:30.645059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:30.646274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:30.647140 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 386/774] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:30.652298 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:30.704527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:30.757578 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab761406-2e67-4a33-b162-270fd8c62995 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:30.793459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:30.794065 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.794341 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.794615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.795731 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:30.796037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:30.797546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:30.802584 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 389/775] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:30.808421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:30.911325 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ede07-6b52-4a79-9ce2-18c53c95486d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:30.945907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:30.946509 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:30.946780 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:30.947043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:30.947672 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:30.947973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:30.949383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:30.954339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 387/776] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:30.960327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:31.060675 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0e46-e996-4373-9da0-859af9e707ce None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:31.074966 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:31.097034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:31.097679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:31.097956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:31.098224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:31.098921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] RBAC: Adding query filter params (interface=public, service_id=55e65167736149f4b3576ae9f1bd8a3e, region_id=RegionOne) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:31.099228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:31.100645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931be6c-b80c-493b-8899-1e412787cc44 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:31.105677 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 390/777] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 13:58:30 2022] GET /identity/v3/endpoints?service_id=55e65167736149f4b3576ae9f1bd8a3e&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:31.111609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:31.139116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:31.216668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664df252-2052-4f63-9fba-82ddbcb87417 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:31.250296 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920561-908c-4789-a044-82c3d3cac23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:31.250900 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920561-908c-4789-a044-82c3d3cac23a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:31.251180 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920561-908c-4789-a044-82c3d3cac23a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:31.251457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920561-908c-4789-a044-82c3d3cac23a None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:31.252044 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22920561-908c-4789-a044-82c3d3cac23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:31.253549 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22920561-908c-4789-a044-82c3d3cac23a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:31.259360 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 388/778] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 13:58:31 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 13:58:32.499963 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27c946-4779-4265-b15d-1f1456695a7e None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:32.500510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27c946-4779-4265-b15d-1f1456695a7e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:32.500696 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27c946-4779-4265-b15d-1f1456695a7e None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:32.502201 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 391/779] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:32.507902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:32.508361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:32.508451 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:32.528117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:32.529356 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:32.605925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 389/780] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:32.945689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27c946-4779-4265-b15d-1f1456695a7e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:33.060077 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27c946-4779-4265-b15d-1f1456695a7e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:33.110493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:33.111398 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:33.111745 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:33.112013 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:33.112598 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:33.114015 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:33.122849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:33.123945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 13:58:33.125012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:33.131394 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 392/781] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Aug 22 13:58:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:33.131551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:33.151980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:33.240316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da374e97-1797-4bae-b10a-3f08af379c0f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:33.279638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:33.280298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:33.280568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:33.280859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:33.281684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:33.281985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:33.283470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdacb1b-5898-4d1d-a8ac-0fd2afe26306 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:33.289053 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 390/782] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Aug 22 13:58:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:33.296165 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:33.343166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:33.404150 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53603ca1-6b53-4263-bd3f-d97432319983 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:33.440349 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:33.440950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:33.441246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:33.441515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:33.442141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:33.442439 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:33.443811 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:33.448911 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 393/783] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Aug 22 13:58:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:33.449031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853918-438c-4385-af5b-fd674b903034 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:33.449331 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853918-438c-4385-af5b-fd674b903034 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:33.449605 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853918-438c-4385-af5b-fd674b903034 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:33.450920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 391/784] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:33.454693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:33.455932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:33.456292 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:33.456630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:33.475940 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:33.477159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:33.547362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 392/785] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:33.562027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f2f23-7002-4caa-b58a-dda7727ceb82 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:33.569498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:33.597797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:33.598406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:33.598681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:33.598951 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:33.599614 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:33.600995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:33.620169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 394/786] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 13:58:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:33.873647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:33.888858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:33.978576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb843353-d5e9-4b08-b38e-17860628b2f2 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:34.019470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:34.020096 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:34.020373 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:34.020642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:34.021255 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:34.022626 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:34.031369 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:34.033160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:34.034113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 393/787] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:34.038964 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:34.143880 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf049e-3636-4a16-a469-979bfa1e1213 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:34.177304 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:34.177906 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:34.178180 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:34.178448 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:34.179072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:34.179373 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:34.180736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:34.185374 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 395/788] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:34.191315 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:34.262354 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:34.292270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815cb18-fab2-478e-95af-f2e90b8ed3e7 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:34.325653 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:34.326250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:34.326525 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:34.326827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:34.327454 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:34.327754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:34.329113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdd1de-14fc-40a9-bccf-ae50e4437194 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:34.333983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 394/789] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Aug 22 13:58:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:34.339953 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:34.367839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:34.442971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1493d-7fd4-4ddd-b6e6-8bc80a82396f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:34.477687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92f006-0586-42e2-9e5e-5abb33ea63c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:34.478293 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f006-0586-42e2-9e5e-5abb33ea63c0 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:34.478573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f006-0586-42e2-9e5e-5abb33ea63c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:34.478843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f006-0586-42e2-9e5e-5abb33ea63c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:34.479503 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92f006-0586-42e2-9e5e-5abb33ea63c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:34.480891 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92f006-0586-42e2-9e5e-5abb33ea63c0 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:34.502853 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 396/790] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 13:58:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:35.816576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0a777-7454-444a-8fc0-a4aaad678109 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:35.817126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0a777-7454-444a-8fc0-a4aaad678109 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:35.817126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0a777-7454-444a-8fc0-a4aaad678109 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:35.818396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 395/791] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:35.824072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:35.824466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:35.824647 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:35.843523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:35.844912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:35.918948 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 397/792] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:36.237990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0a777-7454-444a-8fc0-a4aaad678109 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:36.346538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0a777-7454-444a-8fc0-a4aaad678109 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:36.382285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:36.382916 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:36.383194 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:36.383464 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:36.384043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:36.385464 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:36.388169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:36.395782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:36.396812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:36.402132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 396/793] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:36.403039 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:36.414388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:36.510160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb8a6d-a8b8-4cd6-aab4-fb4cee23d308 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:36.546242 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca344-faa3-4588-a466-14056084d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:36.547010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca344-faa3-4588-a466-14056084d29d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:36.547243 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca344-faa3-4588-a466-14056084d29d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:36.547537 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca344-faa3-4588-a466-14056084d29d None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:36.551260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ca344-faa3-4588-a466-14056084d29d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:36.551260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ca344-faa3-4588-a466-14056084d29d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:36.551260 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ca344-faa3-4588-a466-14056084d29d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:36.558187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 398/794] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:36.564864 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:36.670486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7262e85-aca3-49e8-a71e-c0a29f5e3c89 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:36.705030 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:36.705664 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:36.705936 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:36.706301 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:36.706926 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:36.707223 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:36.708680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcfca-e1f7-48b1-838b-3e2aaf19440e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:36.713460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 397/795] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:36.714737 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1eacd-77e0-4d05-af43-2415964ec5be None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:36.715025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1eacd-77e0-4d05-af43-2415964ec5be None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:36.715293 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1eacd-77e0-4d05-af43-2415964ec5be None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:36.716573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 399/796] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:36.723687 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:36.723950 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:36.724230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:36.744908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:36.746191 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:36.816076 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:36.825511 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 398/797] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:37.145641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1eacd-77e0-4d05-af43-2415964ec5be None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:37.223060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:37.255486 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1eacd-77e0-4d05-af43-2415964ec5be None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:37.290515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:37.291127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:37.291402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:37.291667 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:37.292300 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:37.293764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:37.296778 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING keystone.server.flask.common [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 13:58:37.315588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.sql.core [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 13:58:37.315588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 13:58:37.315588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [parameters: {'id': '89feb031149b43e9958f3e833f886812', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 13:58:37.315588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89feb031149b43e9958f3e833f886812.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89feb031149b43e9958f3e833f886812. Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application conn.query(q) Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 13:58:37.331829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result.read() Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 13:58:37.332660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application next(self.gen) Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application yield resource Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application next(self.gen) Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise self.value Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application session.commit() Aug 22 13:58:37.334117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.session.flush() Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application compat.raise_( Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 13:58:37.335255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 13:58:37.336395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application conn.query(q) Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result.read() Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 13:58:37.337817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [parameters: {'id': '89feb031149b43e9958f3e833f886812', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:37.339038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:37.340016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89feb031149b43e9958f3e833f886812. Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:37.341128 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 400/798] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Aug 22 13:58:37 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:37.341827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:37.442667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474d45-1771-4295-8190-876f3f9f05ae None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:37.477153 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:37.477819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:37.478094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:37.478362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:37.485144 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:37.486627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-799c8bed-8228-4ee6-aaa7-46f1e3034f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:58:37.497677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:37.498675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:37.499676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 399/799] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:37.505063 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:37.615012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8921d3-6afc-47cb-9024-2ca7506768d8 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:37.645674 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:37.654986 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:37.655595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:37.655868 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:37.656131 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:37.656799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:37.657097 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:37.658799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145111f-857e-49f3-a2d4-f1caea2745c2 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:37.809024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 401/800] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:38.882410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b0d3-f0ab-4164-a6af-466b7b9fc9b2 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:38.882935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b0d3-f0ab-4164-a6af-466b7b9fc9b2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:38.882935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b0d3-f0ab-4164-a6af-466b7b9fc9b2 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:38.884218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 400/801] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:38.889936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f675a-a9ef-420a-bdaf-c7a4f38eff12 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:38.890344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f675a-a9ef-420a-bdaf-c7a4f38eff12 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:38.890510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f675a-a9ef-420a-bdaf-c7a4f38eff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:38.909869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-3a8f675a-a9ef-420a-bdaf-c7a4f38eff12 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:38.911470 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-3a8f675a-a9ef-420a-bdaf-c7a4f38eff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:38.985858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 402/802] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:39.315942 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b0d3-f0ab-4164-a6af-466b7b9fc9b2 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:39.375233 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:39.423367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b0d3-f0ab-4164-a6af-466b7b9fc9b2 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:39.460062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9739457-051f-4a0b-9afc-ea3e185e7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:39.460669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9739457-051f-4a0b-9afc-ea3e185e7ae4 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:39.460950 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9739457-051f-4a0b-9afc-ea3e185e7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:39.461213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9739457-051f-4a0b-9afc-ea3e185e7ae4 None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:39.461886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9739457-051f-4a0b-9afc-ea3e185e7ae4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:39.463268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9739457-051f-4a0b-9afc-ea3e185e7ae4 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:39.479236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 401/803] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 13:58:39 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:40.014681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d166b-3040-4257-bbf5-96284954fc25 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:40.015266 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d166b-3040-4257-bbf5-96284954fc25 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:40.015266 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d166b-3040-4257-bbf5-96284954fc25 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:40.016825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 403/804] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:40.022370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:40.022796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:40.022880 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:40.041819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:40.043014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:40.120691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 402/805] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:40 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:40.443514 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d166b-3040-4257-bbf5-96284954fc25 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:40.558081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d166b-3040-4257-bbf5-96284954fc25 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:40.576207 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:40.595360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:40.595975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:40.596257 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:40.596527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:40.597176 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:40.598672 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:40.615025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.sql.core [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 13:58:40.615025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 13:58:40.615025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [parameters: {'user_id': '17d8e7ca108043f79061f46a0b71c248', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 13:58:40.615025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application conn.query(q) Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result.read() Aug 22 13:58:40.622141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 13:58:40.623023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application next(self.gen) Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application yield resource Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application next(self.gen) Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise self.value Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application session.commit() Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 13:58:40.624093 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.session.flush() Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application compat.raise_( Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 13:58:40.625024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 13:58:40.625973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application conn.query(q) Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application result.read() Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 13:58:40.626833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [parameters: {'user_id': '17d8e7ca108043f79061f46a0b71c248', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:40.627663 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 13:58:40.628450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:40.630950 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 404/806] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Aug 22 13:58:40 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:40.631832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:40.673094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:40.733126 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec36f0-ac4c-4ced-8d5f-65e76f98c28f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:40.768035 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:40.768666 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:40.768943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:40.769218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:40.776373 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:40.777872 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-f728c7b4-7980-49eb-a3bf-d058eb1f14a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:58:40.789174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:40.790154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:40.791188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 403/807] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 13:58:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:40.796808 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:40.898152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554611-cd9c-457d-b927-bf9f4e1e684e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:40.933135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:40.933774 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:40.934056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:40.934326 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:40.935022 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:40.935323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:40.937012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046fe0-b049-48a6-9ecd-01bf6c8862cb None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:40.976605 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 405/808] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Aug 22 13:58:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:41.666100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de16-aa1e-440c-bd95-b640448693d2 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:41.666688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de16-aa1e-440c-bd95-b640448693d2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:41.666688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de16-aa1e-440c-bd95-b640448693d2 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:41.667949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 404/809] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 13:58:41.673857 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:41.674312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:41.674418 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:41.693698 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:41.695195 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:41.726089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:41.764739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 406/810] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:41 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:58:42.090044 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de16-aa1e-440c-bd95-b640448693d2 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:42.209748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:42.215058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de16-aa1e-440c-bd95-b640448693d2 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:42.258446 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:42.259068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:42.259344 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:42.259610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:42.260188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:42.261599 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:42.270921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:42.272058 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:58:42.272913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 405/811] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:42.279006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:42.394136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a34d-28a7-4f81-adc1-228528bc255f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:42.430026 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:42.430624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:42.430903 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:42.431171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:42.431795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:42.432090 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:42.433510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:42.438537 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 407/812] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:42.447536 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:42.580917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ea65-8f66-46c5-a8ab-065a7ab2912f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:42.620306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:42.621238 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:42.621614 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:42.621980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:42.622917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:42.623393 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:42.624913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:42.630288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 406/813] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 13:58:42.636939 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:42.673447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:42.747818 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abfc40-076e-40e0-95de-ffea6a1eb802 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:42.783396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:42.783993 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:42.784275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:42.784546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:42.785250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] RBAC: Adding query filter params (interface=public, service_id=dd4bdfd30c864f18844c6adfc1bf584f, region_id=RegionOne) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:42.785579 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:42.786965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d97015-b1dd-4456-800b-f93758b0707a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:42.792100 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 408/814] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 13:58:42 2022] GET /identity/v3/endpoints?service_id=dd4bdfd30c864f18844c6adfc1bf584f&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:42.799625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:42.832592 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:42.916457 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698462d1-3165-4840-a923-8d779ee2cc0e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:42.954783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ececd24-cc2b-4a98-b522-a754be55707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:42.955310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececd24-cc2b-4a98-b522-a754be55707d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:42.955583 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececd24-cc2b-4a98-b522-a754be55707d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:42.955847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececd24-cc2b-4a98-b522-a754be55707d None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:42.956446 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ececd24-cc2b-4a98-b522-a754be55707d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:42.957866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ececd24-cc2b-4a98-b522-a754be55707d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:42.964013 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 407/815] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 13:58:42 2022] GET /identity/v3/services => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 13:58:45.111846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3343e-3e70-4fd9-bb17-187e8d946ab1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:45.112697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3343e-3e70-4fd9-bb17-187e8d946ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:45.112697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3343e-3e70-4fd9-bb17-187e8d946ab1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:45.114830 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 409/816] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:58:45.123022 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:45.123491 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:45.123583 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:45.146318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:58:45.148177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:58:45.227134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 408/817] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:58:45 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:58:45.545551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3343e-3e70-4fd9-bb17-187e8d946ab1 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:45.669173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:45.677445 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3343e-3e70-4fd9-bb17-187e8d946ab1 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:45.720294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:45.720925 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:45.721215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:45.721500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:45.722079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:45.723469 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:58:45.733006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:58:45.734038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:58:45.734919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 410/818] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:58:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:58:45.740670 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:45.766964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:45.846707 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3dac5-e6b1-4cde-af40-fcbc873f5cf2 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:45.882224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:45.882824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:45.883100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:45.883370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:45.883979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:45.884283 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:45.885691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:45.890484 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 409/819] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:45.899862 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:46.029344 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5dbf-32ff-4722-8e5f-3583d6656628 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:46.064559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:46.065159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:46.065467 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:46.065739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:46.066359 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:58:46.066656 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:46.068028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d4ff9-b3f5-44aa-98c6-1c48d628d07e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:46.072829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 411/820] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Aug 22 13:58:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:58:46.079590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:58:46.183557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:46.206917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745043d-6666-4fdb-9a5f-b3a729d7fe2d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:58:46.246039 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a96c95-2f6a-48fd-9fc4-bd5a51a4e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:58:46.246628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96c95-2f6a-48fd-9fc4-bd5a51a4e777 None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:58:46.246902 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96c95-2f6a-48fd-9fc4-bd5a51a4e777 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:58:46.247167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96c95-2f6a-48fd-9fc4-bd5a51a4e777 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:58:46.247818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96c95-2f6a-48fd-9fc4-bd5a51a4e777 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:58:46.249300 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96c95-2f6a-48fd-9fc4-bd5a51a4e777 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:58:46.274452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 410/821] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 13:58:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 13:58:56.070338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=88 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:58:56.269340 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=28,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:49.234092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e15e1-ffde-4e0e-a5d8-838db57b4052 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:49.234780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e15e1-ffde-4e0e-a5d8-838db57b4052 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:49.234780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e15e1-ffde-4e0e-a5d8-838db57b4052 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:49.236366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 412/822] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:59:49.242630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:49.243413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:49.243413 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:49.267026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:59:49.268203 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:59:49.349177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 411/823] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:59:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:59:49.729075 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e15e1-ffde-4e0e-a5d8-838db57b4052 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:49.856769 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e15e1-ffde-4e0e-a5d8-838db57b4052 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:49.897647 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:49.898374 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:49.898701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:49.899004 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:49.912124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:49.914027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:59:49.929685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:49.931019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:59:49.931995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:59:49.931995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:49.931995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:59:49.931995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 413/824] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:49.937147 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:50.059131 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8719-c04e-4253-85b2-dd4f187119ce None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:50.087991 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:50.097932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:50.098973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:50.099301 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:50.099590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:50.100365 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:50.100668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:50.102342 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c7f3-e5b7-40ec-ba96-6afcd49a038a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:50.120465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 412/825] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:50.126200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:50.202095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:50.256203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efeaa5-30ee-4034-a604-fee35c2f894f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:50.292756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f16ad-deb9-43a0-aae9-349ca5fe3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:50.293405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f16ad-deb9-43a0-aae9-349ca5fe3eed None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:50.293692 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f16ad-deb9-43a0-aae9-349ca5fe3eed None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:50.293966 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f16ad-deb9-43a0-aae9-349ca5fe3eed None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:50.294710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f16ad-deb9-43a0-aae9-349ca5fe3eed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:50.296436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f16ad-deb9-43a0-aae9-349ca5fe3eed None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:50.329445 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 414/826] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Aug 22 13:59:50 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 13:59:52.611336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4cf5-2ea6-434d-88ed-1145c403eda7 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:52.612161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4cf5-2ea6-434d-88ed-1145c403eda7 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:52.612161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4cf5-2ea6-434d-88ed-1145c403eda7 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:52.613977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 413/827] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:59:52.621701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:52.622252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:52.622252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:52.642931 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:59:52.644610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:59:52.718329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 415/828] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:59:52 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 13:59:53.045691 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4cf5-2ea6-434d-88ed-1145c403eda7 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:53.157954 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4cf5-2ea6-434d-88ed-1145c403eda7 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:53.213121 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:53.213816 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:53.214130 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:53.214476 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:53.226299 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:59:53.231338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:53.232802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:53.234667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 414/829] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:59:53.240127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:53.284493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:53.352501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb025e-becb-4f39-a2ce-c55846186807 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:53.387507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:53.388621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:53.388621 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:53.388824 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:53.389409 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:53.389703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:53.391155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:53.399948 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 416/830] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:59:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:53.406244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:53.458125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:53.514689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ade8-42c8-4a90-9ecc-5ee1d2de6ae2 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:53.550995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:53.551842 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:53.552169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:53.552502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:53.566268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:53.568325 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:59:53.585332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:53.586529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:59:53.587561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:59:53.587561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:53.587561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:53.587561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 415/831] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:53.592523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:53.699844 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:53.703719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e667-8c19-4bfe-9a59-431fde848190 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:53.746408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:53.747092 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:53.747303 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:53.747582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:53.748523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:53.748963 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:53.750817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:53.765686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 417/832] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:53.773447 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:53.877661 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:53.882346 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb99342-9be7-464b-98ab-4755149c355a None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:53.920634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:53.922019 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:53.922498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:53.922810 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:53.934260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:53.935791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:59:53.947783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:53.948814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:53.949831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 416/833] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:53.956041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:54.069424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07d8c6-e09f-4488-82db-6127910e3978 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:54.112044 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:54.112893 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:54.113385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:54.113719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:54.115161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:54.115161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:54.116797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:54.141314 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 418/834] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Aug 22 13:59:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:54.148001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:54.261228 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd080f-85ac-47aa-9f46-6f3f2410d22c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:54.297485 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:54.298267 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:54.298545 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:54.298937 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:54.328697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:54.375570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:54.377274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:54.488751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 417/835] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 13:59:54 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 13:59:54.495056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:54.516864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:54.609491 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcecd-99f2-4ae5-97e5-fe462e512fae None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:54.644477 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:54.645469 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:54.645758 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:54.646079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:54.658530 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:54.659991 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:59:54.675797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:54.676924 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:59:54.677916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:59:54.677916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:54.677916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:59:54.677916 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 419/836] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:54.683563 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:54.746220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:54.793652 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5f0d-99e2-47a6-a9fa-781e18ef278b None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:54.829701 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:54.830357 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:54.830632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:54.830899 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:54.831570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:54.831912 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:54.833476 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:54.845625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 418/837] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:54.851601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:54.935081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:54.968755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5acc5-33f6-41f3-9a13-6b1bce1103ec None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:55.006918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:55.007622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:55.007907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:55.008169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:55.015313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:55.016788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:59:55.028107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:55.029101 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 13:59:55.030301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 420/838] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:55.035493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:55.141987 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e181b4-9ee3-4225-803d-8d5401bd15c3 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:55.163953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:55.184745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:55.185504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:55.185818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:55.186138 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:55.186904 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:55.187212 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:55.189106 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedc60-0a42-4801-b99a-67a700683087 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:55.202742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 419/839] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:55.209464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:55.334292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4831-21cb-4adb-86a4-3390289b758b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:55.366593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:55.374008 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:55.374687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:55.374988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:55.375268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:55.376127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=3f3cda72513b4690a3b51e81d50a0344) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:55.376505 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:55.378189 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb6ae7-107b-495d-9108-abbbef65f7db None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:55.384748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 421/840] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 13:59:55 2022] GET /identity/v3/role_assignments?user.id=3f3cda72513b4690a3b51e81d50a0344&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:57.521017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdc5cd-f92c-4dad-b739-b99676c25f89 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:57.521719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdc5cd-f92c-4dad-b739-b99676c25f89 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:57.521719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdc5cd-f92c-4dad-b739-b99676c25f89 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:57.523272 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 420/841] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 13:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 13:59:57.528415 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:57.528870 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:57.528978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:57.548127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:59:57.549408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:59:57.620406 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 422/842] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 13:59:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 13:59:57.937777 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdc5cd-f92c-4dad-b739-b99676c25f89 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:58.046819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdc5cd-f92c-4dad-b739-b99676c25f89 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:58.082269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:58.082900 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:58.083169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:58.083437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:58.093467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 13:59:58.098328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:58.099461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:58.100347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 421/843] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 13:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:58.106015 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:58.215293 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431b29-ab70-461c-8406-ec00d9dccafd None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:58.242142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:58.253689 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:58.254368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:58.254673 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:58.255027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:58.255793 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] RBAC: Adding query filter params (name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:58.256095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:58.257779 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:58.266513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 423/844] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 13:59:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:58.272329 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:58.316869 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:58.382918 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba034dd6-1452-418b-b4b6-0b71848a7013 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:58.418555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:58.419339 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:58.419682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:58.420021 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:58.431978 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:58.433685 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:59:58.449362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:58.455379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:59:58.456502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:59:58.456502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:58.456502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:58.456502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 422/845] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:58.456774 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:58.567182 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4c9d4-05b7-4998-b0d1-734b94945fef None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:58.608052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:58.608873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:58.609302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:58.609581 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:58.610388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:58.610773 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:58.612538 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:58.625395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 424/846] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:58.631949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:58.728000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:58.737956 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d659-13a6-462f-9c9a-37bfe2c9f2fe None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:58.773117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:58.773958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:58.774264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:58.774600 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:58.783242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:58.784910 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 13:59:58.798361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:58.799531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:58.800724 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 423/847] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:58.805999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:58.856475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:58.913274 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df1c8-7909-4d4d-b48f-218113189403 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:58.951155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:58.951816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:58.952098 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:58.952370 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:58.953096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:58.953424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:58.954892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:58.974340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 425/848] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Aug 22 13:59:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:58.980770 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:59.092335 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042ed86-2820-44c2-8b2b-ccc721bedd5f None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:59.131445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:59.132083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:59.132365 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:59.132633 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:59.143798 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:59.145297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 13:59:59.160170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:59.161400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 13:59:59.162833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 13:59:59.162833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 13:59:59.162833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:59.162833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 424/849] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 13:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 13:59:59.167450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:59.280226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821deca-9e5f-4aef-9e68-b8a4a21da008 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:59.283231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:59.318570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:59.319187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:59.319465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:59.319734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:59.320436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:59.320739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:59.323151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:59.336544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 426/850] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 13:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:59.342697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:59.345905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:59.456699 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3a4b-410b-4ba1-85bc-0dc29872e9ae None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:59.490048 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:59.490676 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:59.490946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:59.491218 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:59.498733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:59.500295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 13:59:59.512261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 13:59:59.515285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 13:59:59.516439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 425/851] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 13:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 13:59:59.520162 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:59.631450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc59f2-5137-41e6-b62f-19687585091d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:59.670780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:59.671843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:59.672125 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:59.672413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:59.673164 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 13:59:59.673502 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:59.675266 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c828c5-fa39-4fad-9fd2-099122d58101 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:59.688486 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 427/852] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 13:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 13:59:59.695513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:59:59.758615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:59:59.801662 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f446b-9f13-481c-b941-4e955b739a77 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:59:59.838905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ea12-d9bf-4d16-9f4d-5117e8010c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:59:59.839571 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ea12-d9bf-4d16-9f4d-5117e8010c86 None admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:59:59.839852 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ea12-d9bf-4d16-9f4d-5117e8010c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:59:59.840125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ea12-d9bf-4d16-9f4d-5117e8010c86 None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/3f3cda72513b4690a3b51e81d50a0344/roles/681e1245c1ba4c49b5406a98be97a03e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:59:59.855279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123ea12-d9bf-4d16-9f4d-5117e8010c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=3f3cda72513b4690a3b51e81d50a0344, role_id=681e1245c1ba4c49b5406a98be97a03e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:59:59.856888 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123ea12-d9bf-4d16-9f4d-5117e8010c86 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:59:59.869658 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 426/853] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 13:59:59 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/3f3cda72513b4690a3b51e81d50a0344/roles/681e1245c1ba4c49b5406a98be97a03e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:00:02.053655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530416b-1d24-4159-a5aa-4801a986aa55 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:02.054256 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530416b-1d24-4159-a5aa-4801a986aa55 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:02.054256 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530416b-1d24-4159-a5aa-4801a986aa55 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:02.055683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 428/854] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:02.061054 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:02.061510 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:02.061697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:02.080659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:02.081952 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:02.152752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 427/855] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:02 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:02.529542 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530416b-1d24-4159-a5aa-4801a986aa55 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:02.558657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:02.642871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530416b-1d24-4159-a5aa-4801a986aa55 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:02.678354 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:02.679109 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:02.679370 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:02.679659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:02.691570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 14:00:02.696322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:02.697465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:02.698318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 429/856] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Aug 22 14:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:02.704097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:02.747463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:02.806851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe27f-760b-48b3-bae3-46c1dbefc1ce None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:02.842390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:02.843145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:02.843455 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:02.843731 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:02.844587 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] RBAC: Adding query filter params (name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:02.845024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:02.846984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:02.855513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 428/857] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Aug 22 14:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:02.861685 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:02.954941 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:02.971557 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1d9f7-c077-471d-bae1-f7044e104267 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:03.008810 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:03.009480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:03.009811 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:03.010074 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:03.021269 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:03.022735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:03.038566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:03.040173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:03.041488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:03.041488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:03.041488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:03.041488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 430/858] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 14:00:03.045682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:03.162714 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d776f-3a6c-4a63-ab56-ddecec31140d None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:03.165240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:03.201242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:03.201827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:03.202107 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:03.202378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:03.203019 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:03.203318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:03.204697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:03.217215 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 429/859] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 14:00:03.223201 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:03.329523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a34e2-2710-4ec0-82b9-a7c5880c9058 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:03.364158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:03.364787 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:03.365066 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:03.365360 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:03.367983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:03.373243 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:03.374945 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 14:00:03.386202 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:03.387218 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:03.388187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 431/860] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:03.393412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:03.501506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8eebe-c8de-4cfc-99c6-03840d9947be None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:03.539493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:03.540097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:03.540372 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:03.540673 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:03.541462 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:03.541806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:03.543197 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:03.567320 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 430/861] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Aug 22 14:00:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:03.573131 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:03.679408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fe4f-7ef6-404b-99fc-e09fc89a1163 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:03.720104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:03.720960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:03.721312 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:03.721566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:03.792653 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:03.801789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:03.803770 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:03.918935 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 432/862] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 14:00:03 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 14:00:03.925596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:03.953748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:04.038242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e69da-4ef3-4f75-8185-7fd68e67965c None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:04.076919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:04.077812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:04.078188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:04.078672 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:04.090232 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:04.091705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:04.108554 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:04.110190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:04.111740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:04.111740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:04.111740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:04.111740 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 431/863] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:04.116680 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:04.224984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:04.231208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03cf1-908d-4aab-9e29-3f8a24d3348f None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:04.267960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:04.268566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:04.268837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:04.269151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:04.269784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:04.270084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:04.271456 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:04.283605 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 433/864] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:04.289400 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:04.373139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:04.400016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18222a1-968a-46e8-a846-045fc2dce521 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:04.437617 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:04.438257 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:04.438543 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:04.438818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:04.445833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:04.447296 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 14:00:04.458979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:04.467628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:04.468523 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 432/865] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 14:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:04.469089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:04.577002 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ce294-c007-4b92-947c-dad607b41140 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:04.615659 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:04.616309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:04.616553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:04.616835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:04.617573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:04.617858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:04.619298 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607226-7fbf-46e1-b7ff-346f870d4ff6 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:04.631837 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 434/866] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 14:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:04.638421 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:04.744402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35f05-86b8-4555-936d-5a291803f1c1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:04.781623 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:04.782264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:04.782571 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:04.782866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:04.783636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] RBAC: Adding query filter params (role.id=681e1245c1ba4c49b5406a98be97a03e, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=3f3cda72513b4690a3b51e81d50a0344) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:04.784094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:04.785612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a9b1d-effb-4996-8414-f00137849c5d None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:04.787555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:04.792929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 433/867] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 14:00:04 2022] GET /identity/v3/role_assignments?user.id=3f3cda72513b4690a3b51e81d50a0344&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=681e1245c1ba4c49b5406a98be97a03e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:07.021143 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af24e3-c8a9-4aba-9447-296afd52e2b5 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:07.021753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af24e3-c8a9-4aba-9447-296afd52e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:07.021753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af24e3-c8a9-4aba-9447-296afd52e2b5 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:07.023350 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 435/868] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 14:00:07.028602 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:07.029116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:07.029273 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:07.048769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:07.050236 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:07.126561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 434/869] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:07.474533 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af24e3-c8a9-4aba-9447-296afd52e2b5 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:07.494693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:07.589799 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af24e3-c8a9-4aba-9447-296afd52e2b5 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:07.629037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:07.629709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:07.629992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:07.630262 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:07.642180 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 14:00:07.648152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:07.649177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:07.650193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 436/870] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 14:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:07.655825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:07.763367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaea12-2e5c-42cc-9440-52280a9eaacb None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:07.790345 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:07.799039 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:07.799719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:07.799993 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:07.800263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:07.800925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:07.801263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:07.802643 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:07.811227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 435/871] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 14:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:07.817549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:07.899506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:07.926169 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19cd0-8317-475d-81bf-43c2c9d436f4 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:07.965249 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:07.966023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:07.966379 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:07.966718 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:07.977450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:07.978906 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:07.993767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:07.994952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:07.995908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:07.995908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:07.995908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:07.995908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 437/872] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:08.001629 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:08.108061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398d77-53b7-4a0a-b40e-78d800151d94 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:08.148827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:08.149488 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:08.149782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:08.150027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:08.150682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:08.151001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:08.152390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:08.166493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 436/873] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:08.173956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:08.286356 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c491-96f2-47b4-bf5d-5c4a0c6f464d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:08.312790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:08.321976 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:08.322616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:08.322894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:08.323195 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:08.333419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:08.334958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 14:00:08.346845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:08.347858 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:08.348797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 438/874] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 14:00:08.354101 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:08.403998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:08.460909 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb80a4-9e6a-45c5-9095-3fd8494ec262 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:08.494681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:08.495295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:08.495575 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:08.495845 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:08.496561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:08.496866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:08.498342 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:08.520379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 437/875] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Aug 22 14:00:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:08.525197 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:08.642322 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fcab4-80ae-4f9f-8b44-6fb5e46e479a None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:08.678918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:08.679530 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:08.679812 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:08.680084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:08.737678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:08.752141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:08.753990 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:08.863392 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 439/876] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 14:00:08 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 14:00:08.869597 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:08.979108 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8c1b-c3af-4db0-9421-aa5de37237e0 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:08.990031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:09.018075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:09.018886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:09.019069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:09.019318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:09.030990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:09.032467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:09.048336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:09.055260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:09.056463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:09.056463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:09.056463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:09.056463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 438/877] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:09.057462 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:09.156798 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:09.175922 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ace1-ccdc-4d27-8516-44868486e819 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:09.216017 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:09.216624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:09.216899 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:09.217168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:09.217835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:09.218136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:09.219506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:09.231412 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 440/878] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:09.238151 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:09.346636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be564f-ee2b-4de5-8f7c-bbf56f571aab None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:09.383501 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:09.384141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:09.384414 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:09.384683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:09.392446 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:09.394137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 14:00:09.406083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:09.407056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:09.408123 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 439/879] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 14:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:09.413479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:09.518110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5774-0b0d-4905-ba00-a60a8d1de58d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:09.554981 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:09.555601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:09.555872 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:09.556137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:09.556834 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:09.557131 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:09.558649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e183c-3c05-4ca7-bbe1-556e69f08d5c None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:09.571817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 441/880] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 14:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:09.577762 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:09.601677 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:09.681756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927311da-1471-49f6-9b7b-a2f737cedb7e None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:09.714366 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:09.714968 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:09.715246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:09.715517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:09.716245 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=3f3cda72513b4690a3b51e81d50a0344) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:09.716553 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:09.718017 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234da54-2fdd-4610-8954-5e2de8147358 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:09.723448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 440/881] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 14:00:09 2022] GET /identity/v3/role_assignments?user.id=3f3cda72513b4690a3b51e81d50a0344&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:11.907566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10d376-e5ea-4bdb-9b06-d8d9217b468a None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:11.908110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10d376-e5ea-4bdb-9b06-d8d9217b468a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:11.908110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10d376-e5ea-4bdb-9b06-d8d9217b468a None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:11.909580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 442/882] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:11.915945 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:11.916622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:11.916774 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:11.941975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:11.943165 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:12.012031 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 441/883] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:12.341841 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10d376-e5ea-4bdb-9b06-d8d9217b468a None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:12.354493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:12.472752 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10d376-e5ea-4bdb-9b06-d8d9217b468a None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:12.509258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:12.509884 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:12.510161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:12.510429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:12.521368 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 14:00:12.526338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:12.527410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:12.528402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 443/884] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 14:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:12.533801 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:12.549827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:12.635448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3142e3-2a5c-42ad-aecf-061f8468144a None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:12.675753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:12.676359 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:12.676638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:12.676907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:12.677594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:12.677892 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:12.679267 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:12.687349 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 442/885] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 14:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:12.693329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:12.763501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:12.796298 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94082-9c27-4cc5-bd4d-b7eec2def884 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:12.831251 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:12.831863 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:12.832134 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:12.832402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:12.842706 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:12.844147 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:12.858860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:12.861313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:12.862466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:12.862466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:12.862466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:12.862466 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 444/886] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:12.866695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:12.964541 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:12.988073 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820573c-5466-4347-a919-4457c3579f66 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:13.022138 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:13.022725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:13.023005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:13.023275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:13.023905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:13.024205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:13.025580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:13.037069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 443/887] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:13.046491 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:13.155267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0007-3e39-45a5-97d4-b5aa835e299b None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:13.177318 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:13.192813 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:13.193465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:13.193744 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:13.194013 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:13.201507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:13.202961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 14:00:13.214200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:13.215284 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:13.216616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 445/888] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:13.221510 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:13.333570 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7557-a7ad-44e7-813f-5d826c117f5b None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:13.374650 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:13.375242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:13.375512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:13.375778 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:13.376476 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:13.376789 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:13.378308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:13.380862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:13.395742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 444/889] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Aug 22 14:00:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:13.404688 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:13.513725 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e81bd1-cabd-47b3-9ca4-7b3a2b2a4868 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:13.562204 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:13.562836 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:13.563107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:13.563374 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:13.573959 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:13.575392 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:13.589410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:13.590459 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:13.591352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:13.591352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:13.591352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:13.591352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 446/890] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:13.598639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:13.696317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4d2d-9b4b-46ee-a3a4-1a7f4fb78022 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:13.734600 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:13.735196 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:13.735467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:13.735730 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:13.736361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:13.736664 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:13.738097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:13.749154 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 445/891] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:13.757037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:13.790286 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:13.862342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39596b-96e6-4217-bbcb-55c0899f5ac1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:13.899011 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:13.899633 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:13.899913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:13.900183 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:13.907060 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:13.908631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 14:00:13.919775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:13.920757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:13.922246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 447/892] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 14:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 14:00:13.928951 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:13.987334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:14.038222 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca415ed-0fd3-4df4-b39f-e79feb442f34 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:14.075014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:14.075555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:14.075837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:14.076110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:14.076803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:14.077112 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:14.078582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e5cb-1b8c-4b4a-8e90-accee0eb7bde None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:14.091586 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 446/893] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 14:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:14.099803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:14.215479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:14.225405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe3fb-3308-4af6-ad87-84bca88204c4 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:14.261492 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ad7af-0ff7-43a3-a474-83da1b14355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:14.262152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ad7af-0ff7-43a3-a474-83da1b14355d None admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:14.262429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ad7af-0ff7-43a3-a474-83da1b14355d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:14.262701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ad7af-0ff7-43a3-a474-83da1b14355d None admin] PATH_INFO: `/v3/projects/05fe66912a0f4de3b5a751774422a074/users/3f3cda72513b4690a3b51e81d50a0344/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:14.264901 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ad7af-0ff7-43a3-a474-83da1b14355d None admin] RBAC: Authorizing `identity:create_grant(project_id=05fe66912a0f4de3b5a751774422a074, user_id=3f3cda72513b4690a3b51e81d50a0344, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:14.266386 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ad7af-0ff7-43a3-a474-83da1b14355d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:14.282083 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 448/894] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Aug 22 14:00:14 2022] PUT /identity/v3/projects/05fe66912a0f4de3b5a751774422a074/users/3f3cda72513b4690a3b51e81d50a0344/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:00:16.403934 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2ea7-822b-4a6c-98ff-64d88a1ca0fb None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:16.404497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2ea7-822b-4a6c-98ff-64d88a1ca0fb None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:16.404497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2ea7-822b-4a6c-98ff-64d88a1ca0fb None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:16.405845 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 447/895] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:16.412376 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:16.413102 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:16.413281 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:16.443325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:16.444523 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:16.518675 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 449/896] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:16.854684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2ea7-822b-4a6c-98ff-64d88a1ca0fb None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:16.962018 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2ea7-822b-4a6c-98ff-64d88a1ca0fb None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:16.978817 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:17.009220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:17.009892 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:17.010170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:17.010455 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:17.020997 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 14:00:17.025725 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:17.026786 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:17.030206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 448/897] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Aug 22 14:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:17.033024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:17.116032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:17.138527 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74454aca-e100-4e88-9688-3f2420b7a05a None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:17.179919 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:17.180614 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:17.180972 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:17.181258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:17.182049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:17.182364 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:17.184056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:17.194416 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 450/898] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Aug 22 14:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:17.201584 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:17.317505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4354e2-370c-46bf-8340-eaea4ad081ec None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:17.357032 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:17.358033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:17.358423 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:17.358773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:17.371033 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:17.372406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:17.387136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:17.388261 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:17.389149 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:17.389149 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:17.389149 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:17.389149 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 449/899] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 14:00:17.396117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:17.503268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0130cd-ffd6-4adb-a666-40c95baf3c3e None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:17.546122 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:17.547337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:17.547693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:17.548051 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:17.548995 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:17.549408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:17.551413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:17.564562 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 451/900] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:17.570534 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:17.599298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:17.672946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f78b-6137-4361-b08f-0b1552579b17 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:17.720505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:17.721386 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:17.721873 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:17.722224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:17.729875 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:17.731318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 14:00:17.742337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:17.743429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:17.744551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 450/901] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:17.749481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:17.753978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:17.852643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eec2f-4e31-4d26-a738-e371650ab98d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:17.887907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:17.888493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:17.888766 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:17.889029 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:17.889777 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:17.890075 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:17.891501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:17.913568 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 452/902] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Aug 22 14:00:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:17.923445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:18.024049 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:18.041128 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d955c-c694-46af-a969-7d41cd3c0796 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:18.078226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:18.078836 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:18.079111 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:18.079383 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:18.149800 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:18.151277 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:18.231971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:18.249790 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 451/903] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Aug 22 14:00:17 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 14:00:18.256420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:18.325823 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:18.371978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e09a-a50e-4ff9-a6a7-1fd65a23f1a1 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:18.408137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:18.408760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:18.409061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:18.409334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:18.419777 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:18.421212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 14:00:18.437062 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:18.438369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 14:00:18.439358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 14:00:18.439358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 14:00:18.439358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:18.439358 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 453/904] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:18.446139 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:18.545159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d8706-1f14-416c-bd37-ae83920bcfa1 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:18.588968 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:18.589683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:18.590042 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:18.590422 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:18.591403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:18.591827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:18.594047 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:18.607387 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 452/905] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Aug 22 14:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:18.614141 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:18.721105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd57e3-e52a-421f-91aa-ce65dc3a3b39 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:18.736496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:18.758868 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:18.759506 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:18.759877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:18.760146 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:18.767263 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:18.768727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 14:00:18.779825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:18.780894 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: ERROR keystone.server.flask.application Aug 22 14:00:18.781984 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 454/906] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Aug 22 14:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:18.787682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:18.846000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:18.909357 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad90e58-617a-41d5-926a-96880dc68708 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:18.950267 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:18.951269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:18.951728 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:18.952171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:18.953290 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:18.953829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:18.956171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75078-1d6d-4692-bafa-979b9cdbd840 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:18.969913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 453/907] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Aug 22 14:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:18.976449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:19.084084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af2a6-dad1-4cf5-b3bf-80762bb95335 None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:19.118631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:19.119157 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:19.119471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:19.119736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:19.120435 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] RBAC: Adding query filter params (role.id=464333398f24462987d7dbfb8e31ccd9, scope.project.id=05fe66912a0f4de3b5a751774422a074, user.id=3f3cda72513b4690a3b51e81d50a0344) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:19.120737 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:19.122208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38b13-c91b-4e2a-bf59-d10ca157ed3d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:19.127983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 455/908] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Aug 22 14:00:18 2022] GET /identity/v3/role_assignments?user.id=3f3cda72513b4690a3b51e81d50a0344&scope.project.id=05fe66912a0f4de3b5a751774422a074&role.id=464333398f24462987d7dbfb8e31ccd9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:21.343250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b592782-7e95-435b-8eb6-4d479559a657 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:21.344136 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b592782-7e95-435b-8eb6-4d479559a657 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:21.344279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b592782-7e95-435b-8eb6-4d479559a657 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:21.346227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 454/909] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:21.352914 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:21.353387 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:21.353480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:21.371810 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:21.372983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:21.403325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:21.445647 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 456/910] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:21.776641 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b592782-7e95-435b-8eb6-4d479559a657 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:21.886721 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b592782-7e95-435b-8eb6-4d479559a657 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:21.894781 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:21.927350 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:21.927967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:21.928239 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:21.928502 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:21.929076 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:21.930484 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:21.939376 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:21.940493 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:21.941463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 455/911] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Aug 22 14:00:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:21.947501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:22.052012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21c0f6-c486-4209-9def-f63a3814d85b None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:22.088703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:22.089334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:22.089607 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:22.089877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:22.090502 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:22.090809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:22.092174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282d3f-3c73-493b-9518-bdf50538dec8 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:22.097520 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 457/912] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Aug 22 14:00:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:22.106447 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:22.231270 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8f5cb-5740-456a-8ea4-2b250234c603 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:22.267582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:22.267972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:22.268253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:22.268524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] PATH_INFO: `/v3/services` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:22.269156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] RBAC: Adding query filter params (type=placement) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:22.269549 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:22.270937 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587b2e4-a4af-418f-b167-e4df29a2c29b None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:22.275515 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 456/913] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Aug 22 14:00:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:24.419473 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4ad47-e8f5-4154-b7f9-5b730a2fb708 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:24.420365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4ad47-e8f5-4154-b7f9-5b730a2fb708 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:24.420365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4ad47-e8f5-4154-b7f9-5b730a2fb708 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:24.422883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 458/914] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:24.431710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621941-c98e-42bd-a82b-7c0222c06ad1 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:24.432113 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621941-c98e-42bd-a82b-7c0222c06ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:24.432310 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621941-c98e-42bd-a82b-7c0222c06ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:24.455973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-fc621941-c98e-42bd-a82b-7c0222c06ad1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:24.457250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-fc621941-c98e-42bd-a82b-7c0222c06ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:24.488663 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:24.534268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 457/915] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:24.858297 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4ad47-e8f5-4154-b7f9-5b730a2fb708 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:24.900908 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:24.979096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4ad47-e8f5-4154-b7f9-5b730a2fb708 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:25.019267 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d59c9-3383-46d4-bd72-034a5692e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:25.019940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d59c9-3383-46d4-bd72-034a5692e527 None admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:25.020215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d59c9-3383-46d4-bd72-034a5692e527 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:25.020489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d59c9-3383-46d4-bd72-034a5692e527 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:25.021127 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d59c9-3383-46d4-bd72-034a5692e527 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:25.022542 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d59c9-3383-46d4-bd72-034a5692e527 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:25.040057 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 459/916] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Aug 22 14:00:24 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:00:27.204470 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f8b17-3330-4192-af1d-a91eeb209c5a None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:27.205037 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f8b17-3330-4192-af1d-a91eeb209c5a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:27.205037 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f8b17-3330-4192-af1d-a91eeb209c5a None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:27.206879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 458/917] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:27.213531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:27.214244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:27.214377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:27.242072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:27.243252 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:27.320500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 460/918] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:27 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 14:00:27.640234 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f8b17-3330-4192-af1d-a91eeb209c5a None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:27.756137 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f8b17-3330-4192-af1d-a91eeb209c5a None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:27.793537 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:27.794156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:27.794427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:27.794696 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:27.795274 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:27.796649 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:27.806482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:27.807588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:27.808788 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 459/919] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Aug 22 14:00:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:27.814337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:27.839304 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:27.919912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2bc0-42bd-41e2-88e4-77835140e9fb None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:27.957643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:27.958257 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:27.958537 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:27.958811 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:27.959436 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:27.959742 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:27.961120 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:27.966158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 461/920] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Aug 22 14:00:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:27.972372 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:28.002620 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:28.090773 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa58d-711a-4ee1-9f8b-e173b3198e40 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:28.131024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:28.131634 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:28.131913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:28.132184 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:28.132885 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] RBAC: Adding query filter params (interface=public, service_id=e853f010a5094620ac325e2f5ba60f5a, region_id=RegionOne) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:28.133211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:28.134611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1024-7fc4-4098-abfd-37bd031396d2 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:28.139680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 460/921] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Aug 22 14:00:27 2022] GET /identity/v3/endpoints?service_id=e853f010a5094620ac325e2f5ba60f5a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:28.146444 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:28.235874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:28.255809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548e777-400f-4a73-83ff-de269c39498d None admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:28.293583 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a95a64-18fe-403f-b50c-4e6a5be3d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:28.294177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a95a64-18fe-403f-b50c-4e6a5be3d367 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:28.294465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a95a64-18fe-403f-b50c-4e6a5be3d367 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:28.294736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a95a64-18fe-403f-b50c-4e6a5be3d367 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:28.295338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a95a64-18fe-403f-b50c-4e6a5be3d367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:28.296720 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a95a64-18fe-403f-b50c-4e6a5be3d367 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:28.303748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 462/922] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Aug 22 14:00:28 2022] GET /identity/v3/services => generated 1962 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:00:30.434776 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2c0d-047f-4cbc-b832-f8edcf92a8b5 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:30.435766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2c0d-047f-4cbc-b832-f8edcf92a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:30.435766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2c0d-047f-4cbc-b832-f8edcf92a8b5 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:30.437821 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 461/923] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:00:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:00:30.445011 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:30.445876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:30.445876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:30.473216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:00:30.474929 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:00:30.559377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 463/924] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:00:30 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 14:00:30.884433 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b2c0d-047f-4cbc-b832-f8edcf92a8b5 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:30.986170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:30.996571 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b2c0d-047f-4cbc-b832-f8edcf92a8b5 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:31.031790 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:31.032414 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:31.032692 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:31.032938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:31.033567 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:31.034946 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 14:00:31.043982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 14:00:31.045216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application with Lock( Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self._enter() Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application return self.creator() Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application created_value = creator( Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: ERROR keystone.server.flask.application Aug 22 14:00:31.046142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 462/925] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Aug 22 14:00:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 14:00:31.052046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:31.129016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:31.156559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5fa9c-f57e-4b37-b01b-4101947274b8 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:31.191255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:31.191902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:31.192179 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:31.192449 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] PATH_INFO: `/v3/services` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:31.193072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:00:31.193410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:31.194790 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6121add-075f-4b5b-a5c4-2a3ccc2ecc47 None admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:31.199723 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 464/926] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Aug 22 14:00:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:00:31.208829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:00:31.321743 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e07055-6572-4c5e-abff-06afbda81e14 None admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:00:31.359052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c62677-ea8b-46ae-9e13-91731a3f1d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:00:31.359647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c62677-ea8b-46ae-9e13-91731a3f1d8e None admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:00:31.359920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c62677-ea8b-46ae-9e13-91731a3f1d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:00:31.360193 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c62677-ea8b-46ae-9e13-91731a3f1d8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:00:31.360845 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c62677-ea8b-46ae-9e13-91731a3f1d8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:00:31.362255 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c62677-ea8b-46ae-9e13-91731a3f1d8e None admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:00:31.386628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 463/927] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 14:00:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:00:41.197340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=30 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:00:41.382128 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:01:31.279192 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c58ae-4fa6-4537-a5eb-5248a47c7e0c None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:31.279768 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c58ae-4fa6-4537-a5eb-5248a47c7e0c None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:31.279768 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c58ae-4fa6-4537-a5eb-5248a47c7e0c None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:31.285014 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 465/928] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:31.286463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97718-231a-4317-9dd5-73cceda3da41 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:31.286907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97718-231a-4317-9dd5-73cceda3da41 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:31.286986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97718-231a-4317-9dd5-73cceda3da41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:31.307932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-86b97718-231a-4317-9dd5-73cceda3da41 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:31.309775 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-86b97718-231a-4317-9dd5-73cceda3da41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:31.425267 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 464/929] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:31.766190 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c633c-6797-4c8a-bd6d-3c874d389ebf None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:31.766479 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c633c-6797-4c8a-bd6d-3c874d389ebf None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:31.766864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c633c-6797-4c8a-bd6d-3c874d389ebf None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:31.768388 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 466/930] 10.222.0.40 () {54 vars in 965 bytes} [Mon Aug 22 14:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:31.775380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6aa6a-8b2c-4748-83ed-ef5ed67e5664 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:31.775723 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6aa6a-8b2c-4748-83ed-ef5ed67e5664 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:31.775918 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6aa6a-8b2c-4748-83ed-ef5ed67e5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:31.866842 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d2c6aa6a-8b2c-4748-83ed-ef5ed67e5664 None None] MFA Rules not processed for user `2800cc436ad94811b4e938ee81124b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:31.868134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d2c6aa6a-8b2c-4748-83ed-ef5ed67e5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:31.937936 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 465/931] 10.222.0.40 () {58 vars in 1062 bytes} [Mon Aug 22 14:01:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:31.946803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c633c-6797-4c8a-bd6d-3c874d389ebf None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:31.957650 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c633c-6797-4c8a-bd6d-3c874d389ebf None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:31.961210 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907f2a9-e889-4a60-8209-7df8e1824730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:31.961802 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f2a9-e889-4a60-8209-7df8e1824730 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:31.962078 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f2a9-e889-4a60-8209-7df8e1824730 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:31.962346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f2a9-e889-4a60-8209-7df8e1824730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:31.971432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907f2a9-e889-4a60-8209-7df8e1824730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:31.972855 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907f2a9-e889-4a60-8209-7df8e1824730 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:31.982300 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 467/932] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:34.422052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9552e4-3e17-4dd2-8777-3f82167f8334 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:34.422635 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9552e4-3e17-4dd2-8777-3f82167f8334 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:34.422635 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9552e4-3e17-4dd2-8777-3f82167f8334 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:34.424294 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 466/933] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:34.429972 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441c1ee-7069-407b-9d32-35035ff870f4 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:34.430403 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441c1ee-7069-407b-9d32-35035ff870f4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:34.430518 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441c1ee-7069-407b-9d32-35035ff870f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:34.450657 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0441c1ee-7069-407b-9d32-35035ff870f4 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:34.451866 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0441c1ee-7069-407b-9d32-35035ff870f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:34.461171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 468/934] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:34.799407 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9552e4-3e17-4dd2-8777-3f82167f8334 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:34.811355 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9552e4-3e17-4dd2-8777-3f82167f8334 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:34.815362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b577ba-e658-4c40-9e94-b8a7cc35dec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:34.815985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b577ba-e658-4c40-9e94-b8a7cc35dec1 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:34.816263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b577ba-e658-4c40-9e94-b8a7cc35dec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:34.816530 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b577ba-e658-4c40-9e94-b8a7cc35dec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:34.826812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b577ba-e658-4c40-9e94-b8a7cc35dec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:34.828280 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b577ba-e658-4c40-9e94-b8a7cc35dec1 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:34.839178 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 467/935] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:37.332942 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a8b41-ec99-4f3b-afc2-c70f816a212b None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:37.333776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a8b41-ec99-4f3b-afc2-c70f816a212b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:37.333776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a8b41-ec99-4f3b-afc2-c70f816a212b None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:37.335086 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 469/936] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:37.340172 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3bee-9ecd-4a4d-93e5-6c16d15a49ee None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:37.340582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3bee-9ecd-4a4d-93e5-6c16d15a49ee None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:37.340657 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3bee-9ecd-4a4d-93e5-6c16d15a49ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:37.379923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-1e9e3bee-9ecd-4a4d-93e5-6c16d15a49ee None None] MFA Rules not processed for user `03d11c48f9b14945aa9338b717dc969b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:37.381134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-1e9e3bee-9ecd-4a4d-93e5-6c16d15a49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:37.422575 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:01:37.451970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 468/937] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:37 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:37.806166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366b88-de10-447d-babd-275c7613a2c9 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:37.806554 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366b88-de10-447d-babd-275c7613a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:37.806726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366b88-de10-447d-babd-275c7613a2c9 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:37.808208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 470/938] 10.222.0.40 () {54 vars in 965 bytes} [Mon Aug 22 14:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:37.814240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6425c-4437-42e5-ae0b-02d4a0e1742e None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:37.814688 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6425c-4437-42e5-ae0b-02d4a0e1742e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:37.815068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6425c-4437-42e5-ae0b-02d4a0e1742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:37.836441 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d1b6425c-4437-42e5-ae0b-02d4a0e1742e None None] MFA Rules not processed for user `2800cc436ad94811b4e938ee81124b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:37.837866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d1b6425c-4437-42e5-ae0b-02d4a0e1742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:37.844995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 469/939] 10.222.0.40 () {58 vars in 1062 bytes} [Mon Aug 22 14:01:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:37.854151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366b88-de10-447d-babd-275c7613a2c9 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:37.865967 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366b88-de10-447d-babd-275c7613a2c9 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:37.870498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0874d9-8b5b-48f9-80b2-9274a0679cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:37.871100 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0874d9-8b5b-48f9-80b2-9274a0679cca service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:37.871376 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0874d9-8b5b-48f9-80b2-9274a0679cca service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:37.871642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0874d9-8b5b-48f9-80b2-9274a0679cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:37.881605 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0874d9-8b5b-48f9-80b2-9274a0679cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:37.883158 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0874d9-8b5b-48f9-80b2-9274a0679cca service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:37.893242 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 471/940] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:37 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:40.991431 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afc97f-51f8-4c42-8622-b1c650adf6fc None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:40.992001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afc97f-51f8-4c42-8622-b1c650adf6fc None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:40.992001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afc97f-51f8-4c42-8622-b1c650adf6fc None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:40.993330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 470/941] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:40.999551 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a463f-be77-4976-ae2e-1498cfe51a7e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:41.000236 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a463f-be77-4976-ae2e-1498cfe51a7e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:41.000379 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a463f-be77-4976-ae2e-1498cfe51a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:41.022956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-498a463f-be77-4976-ae2e-1498cfe51a7e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:41.024142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-498a463f-be77-4976-ae2e-1498cfe51a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:41.094405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 472/942] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:40 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:41.431613 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afc97f-51f8-4c42-8622-b1c650adf6fc None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:41.444898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afc97f-51f8-4c42-8622-b1c650adf6fc None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:41.449008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b3c62-19b2-437e-972a-17d26f1a74a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:41.449685 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3c62-19b2-437e-972a-17d26f1a74a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:41.449967 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3c62-19b2-437e-972a-17d26f1a74a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:41.450242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3c62-19b2-437e-972a-17d26f1a74a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:41.460751 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b3c62-19b2-437e-972a-17d26f1a74a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:41.462231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b3c62-19b2-437e-972a-17d26f1a74a3 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:41.472759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 471/943] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:41 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:44.343135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfa59-7c6c-42cb-8b51-a4af5ad7e895 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:44.343734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfa59-7c6c-42cb-8b51-a4af5ad7e895 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:44.343734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfa59-7c6c-42cb-8b51-a4af5ad7e895 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:44.345452 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 473/944] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:44.350490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9df25e-62ae-48c5-8873-4ad9a0edad07 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:44.350909 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9df25e-62ae-48c5-8873-4ad9a0edad07 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:44.351034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9df25e-62ae-48c5-8873-4ad9a0edad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:44.370564 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-5d9df25e-62ae-48c5-8873-4ad9a0edad07 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:44.371753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-5d9df25e-62ae-48c5-8873-4ad9a0edad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:44.380041 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 472/945] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:44.725943 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfa59-7c6c-42cb-8b51-a4af5ad7e895 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:44.737771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfa59-7c6c-42cb-8b51-a4af5ad7e895 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:44.741599 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503bc7d-3632-455f-aa8f-e9fe3d740495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:44.742200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503bc7d-3632-455f-aa8f-e9fe3d740495 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:44.742485 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503bc7d-3632-455f-aa8f-e9fe3d740495 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:44.742743 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503bc7d-3632-455f-aa8f-e9fe3d740495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:44.751876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503bc7d-3632-455f-aa8f-e9fe3d740495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:44.753342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503bc7d-3632-455f-aa8f-e9fe3d740495 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:44.763047 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 474/946] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:46.966380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a357e8-bf47-40ed-88d1-8d380d165ad4 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:46.966971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a357e8-bf47-40ed-88d1-8d380d165ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:46.966971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a357e8-bf47-40ed-88d1-8d380d165ad4 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:46.968220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 473/947] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:46.973892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3cfab-6fd6-48db-9828-17c43e2d7a9c None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:46.974352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3cfab-6fd6-48db-9828-17c43e2d7a9c None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:46.974453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3cfab-6fd6-48db-9828-17c43e2d7a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:46.996734 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-d9b3cfab-6fd6-48db-9828-17c43e2d7a9c None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:46.997987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-d9b3cfab-6fd6-48db-9828-17c43e2d7a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:47.006443 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 475/948] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:47.342540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a357e8-bf47-40ed-88d1-8d380d165ad4 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:47.354328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a357e8-bf47-40ed-88d1-8d380d165ad4 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:47.358069 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82906c8a-bd01-4c2a-8c76-ba628fa845a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:47.358701 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906c8a-bd01-4c2a-8c76-ba628fa845a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:47.358979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906c8a-bd01-4c2a-8c76-ba628fa845a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:47.359222 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906c8a-bd01-4c2a-8c76-ba628fa845a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:47.368933 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82906c8a-bd01-4c2a-8c76-ba628fa845a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:47.370408 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82906c8a-bd01-4c2a-8c76-ba628fa845a5 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:47.379949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 474/949] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:49.589472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2a79-83d3-4cd6-be8d-0727e035a00f None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:49.589983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2a79-83d3-4cd6-be8d-0727e035a00f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:49.590090 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2a79-83d3-4cd6-be8d-0727e035a00f None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:49.591385 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 476/950] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:49.596834 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0ba5e-7e68-48c7-9b27-2c929e8abf5b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:49.597326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0ba5e-7e68-48c7-9b27-2c929e8abf5b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:49.597418 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0ba5e-7e68-48c7-9b27-2c929e8abf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:49.617807 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d4f0ba5e-7e68-48c7-9b27-2c929e8abf5b None None] MFA Rules not processed for user `03d11c48f9b14945aa9338b717dc969b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:49.619028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d4f0ba5e-7e68-48c7-9b27-2c929e8abf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:49.630602 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 475/951] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:49 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:49.995626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2a79-83d3-4cd6-be8d-0727e035a00f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:50.009220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2a79-83d3-4cd6-be8d-0727e035a00f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:50.013495 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e2df3-b385-4101-af1d-e5ad9cc76f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:50.014125 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2df3-b385-4101-af1d-e5ad9cc76f55 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:50.014408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2df3-b385-4101-af1d-e5ad9cc76f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:50.014678 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2df3-b385-4101-af1d-e5ad9cc76f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:50.024915 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e2df3-b385-4101-af1d-e5ad9cc76f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:50.026403 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e2df3-b385-4101-af1d-e5ad9cc76f55 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:50.036154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 477/952] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:49 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:52.449560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840d97-f352-4887-8235-e03abbdaedb8 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:52.450156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840d97-f352-4887-8235-e03abbdaedb8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:52.450156 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840d97-f352-4887-8235-e03abbdaedb8 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:52.451419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 476/953] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:52.456910 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17c7e-8aaa-46a0-bb45-fca831014143 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:52.457396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17c7e-8aaa-46a0-bb45-fca831014143 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:52.457489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17c7e-8aaa-46a0-bb45-fca831014143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:52.477137 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b4d17c7e-8aaa-46a0-bb45-fca831014143 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:52.478350 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b4d17c7e-8aaa-46a0-bb45-fca831014143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:52.486906 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 478/954] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:52.819186 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840d97-f352-4887-8235-e03abbdaedb8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:52.831856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840d97-f352-4887-8235-e03abbdaedb8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:52.836166 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14818b1c-3178-46f9-a973-af23c0da7d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:52.836761 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818b1c-3178-46f9-a973-af23c0da7d29 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:52.837034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818b1c-3178-46f9-a973-af23c0da7d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:52.837341 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818b1c-3178-46f9-a973-af23c0da7d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:52.851157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14818b1c-3178-46f9-a973-af23c0da7d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:52.852597 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14818b1c-3178-46f9-a973-af23c0da7d29 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:52.862573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 477/955] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:55.094831 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2483ab-26a6-4704-85ab-09024b24cf9c None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:55.095371 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2483ab-26a6-4704-85ab-09024b24cf9c None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:55.095371 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2483ab-26a6-4704-85ab-09024b24cf9c None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:55.096727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 479/956] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:55.102269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbee8-011c-4603-88db-9da11ee9dd78 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:55.102736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbee8-011c-4603-88db-9da11ee9dd78 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:55.102838 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbee8-011c-4603-88db-9da11ee9dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:55.122277 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-2e2bbee8-011c-4603-88db-9da11ee9dd78 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:55.123462 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-2e2bbee8-011c-4603-88db-9da11ee9dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:55.131886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 478/957] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:01:55.476395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2483ab-26a6-4704-85ab-09024b24cf9c None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:55.488164 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2483ab-26a6-4704-85ab-09024b24cf9c None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:55.492154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9204b4f-218c-45e0-ba78-6f1646a6c3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:55.492921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204b4f-218c-45e0-ba78-6f1646a6c3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:55.493213 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204b4f-218c-45e0-ba78-6f1646a6c3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:55.493770 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204b4f-218c-45e0-ba78-6f1646a6c3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:55.503333 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9204b4f-218c-45e0-ba78-6f1646a6c3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:55.504856 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9204b4f-218c-45e0-ba78-6f1646a6c3e3 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:55.515601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 480/958] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:01:58.004709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ac32-64f5-4e1f-a22e-568fd6d1cf52 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:58.005332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ac32-64f5-4e1f-a22e-568fd6d1cf52 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:58.005332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ac32-64f5-4e1f-a22e-568fd6d1cf52 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:58.006625 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 479/959] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:01:58.013012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c2ad-b351-44a2-9351-bff30e11f820 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:58.013767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c2ad-b351-44a2-9351-bff30e11f820 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:58.013912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c2ad-b351-44a2-9351-bff30e11f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:58.038843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-16d7c2ad-b351-44a2-9351-bff30e11f820 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:01:58.040040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-16d7c2ad-b351-44a2-9351-bff30e11f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:01:58.050186 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 481/960] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:01:58 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:01:58.390070 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35ac32-64f5-4e1f-a22e-568fd6d1cf52 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:01:58.402657 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35ac32-64f5-4e1f-a22e-568fd6d1cf52 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:01:58.406483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb37d6-980b-4ea0-be83-06188c1ccf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:01:58.407077 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb37d6-980b-4ea0-be83-06188c1ccf15 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:01:58.407349 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb37d6-980b-4ea0-be83-06188c1ccf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:01:58.407622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb37d6-980b-4ea0-be83-06188c1ccf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:01:58.417258 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb37d6-980b-4ea0-be83-06188c1ccf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:01:58.418722 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb37d6-980b-4ea0-be83-06188c1ccf15 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:01:58.429390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 480/961] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:01:58 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:02:02.551588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb8df-022a-4fdf-9395-c3f52eb40a35 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:02.552174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb8df-022a-4fdf-9395-c3f52eb40a35 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:02.552174 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb8df-022a-4fdf-9395-c3f52eb40a35 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:02.553634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 482/962] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:02.559344 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462925-d6fb-4fd1-ad81-56c8eecfadcd None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:02.559792 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462925-d6fb-4fd1-ad81-56c8eecfadcd None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:02.559891 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462925-d6fb-4fd1-ad81-56c8eecfadcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:02.579440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-9f462925-d6fb-4fd1-ad81-56c8eecfadcd None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:02.580627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-9f462925-d6fb-4fd1-ad81-56c8eecfadcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:02.588883 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 481/963] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:02.925992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb8df-022a-4fdf-9395-c3f52eb40a35 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:02.932849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=74 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:02:02.939800 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb8df-022a-4fdf-9395-c3f52eb40a35 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:02.943628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b14b0-946b-43e9-92d9-f9ef91f17dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:02.944241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b14b0-946b-43e9-92d9-f9ef91f17dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:02.944592 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b14b0-946b-43e9-92d9-f9ef91f17dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:02.944870 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b14b0-946b-43e9-92d9-f9ef91f17dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:02.954642 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b14b0-946b-43e9-92d9-f9ef91f17dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:02.956090 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b14b0-946b-43e9-92d9-f9ef91f17dc0 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:02.966153 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 483/964] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:05.956167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75c9b2-a2a8-486c-b13d-ef4b145ff9a8 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:05.956719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75c9b2-a2a8-486c-b13d-ef4b145ff9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:05.956719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75c9b2-a2a8-486c-b13d-ef4b145ff9a8 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:05.958806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 482/965] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:05.964265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338c22d-867e-4146-bc75-dd38bcb161e1 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:05.964666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338c22d-867e-4146-bc75-dd38bcb161e1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:05.964819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338c22d-867e-4146-bc75-dd38bcb161e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:05.984313 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-c338c22d-867e-4146-bc75-dd38bcb161e1 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:05.985500 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-c338c22d-867e-4146-bc75-dd38bcb161e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:05.993566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 484/966] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:05 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:06.343057 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75c9b2-a2a8-486c-b13d-ef4b145ff9a8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:06.356843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75c9b2-a2a8-486c-b13d-ef4b145ff9a8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:06.361407 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a887-933a-4b84-8d92-8d27442dad42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:06.362002 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a887-933a-4b84-8d92-8d27442dad42 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:06.362275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a887-933a-4b84-8d92-8d27442dad42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:06.362537 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a887-933a-4b84-8d92-8d27442dad42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:06.371893 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24a887-933a-4b84-8d92-8d27442dad42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:06.373484 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24a887-933a-4b84-8d92-8d27442dad42 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:06.383544 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 483/967] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:06 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:10.724302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fb70-cdd9-47b3-90de-47b87fb94fdb None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:10.724770 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fb70-cdd9-47b3-90de-47b87fb94fdb None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:10.724847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fb70-cdd9-47b3-90de-47b87fb94fdb None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:10.726405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 485/968] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:10.731846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb7b8a-413c-42b8-ba4c-37c5c4b2e186 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:10.732227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb7b8a-413c-42b8-ba4c-37c5c4b2e186 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:10.732391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb7b8a-413c-42b8-ba4c-37c5c4b2e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:10.739825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=57 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:02:10.753959 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-59bb7b8a-413c-42b8-ba4c-37c5c4b2e186 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:10.755157 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-59bb7b8a-413c-42b8-ba4c-37c5c4b2e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:10.763009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 484/969] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:11.094415 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fb70-cdd9-47b3-90de-47b87fb94fdb None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:11.106847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fb70-cdd9-47b3-90de-47b87fb94fdb None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:11.110922 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a8b97-9c52-4ec8-bd70-1c875185233a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:11.111515 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a8b97-9c52-4ec8-bd70-1c875185233a service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:11.111773 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a8b97-9c52-4ec8-bd70-1c875185233a service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:11.112038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a8b97-9c52-4ec8-bd70-1c875185233a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:11.121573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a8b97-9c52-4ec8-bd70-1c875185233a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:11.122996 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a8b97-9c52-4ec8-bd70-1c875185233a service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:11.132542 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 486/970] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:16.696238 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3a93-bc48-4716-b9b7-c685c4f1128f None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:16.696704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3a93-bc48-4716-b9b7-c685c4f1128f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:16.696782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3a93-bc48-4716-b9b7-c685c4f1128f None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:16.698486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 485/971] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:16.707034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e02ee-80fe-4b81-82e5-b46d4294fdf4 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:16.707513 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e02ee-80fe-4b81-82e5-b46d4294fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:16.707786 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e02ee-80fe-4b81-82e5-b46d4294fdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:16.777345 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b73e02ee-80fe-4b81-82e5-b46d4294fdf4 None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:16.778687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b73e02ee-80fe-4b81-82e5-b46d4294fdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:16.861269 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 487/972] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:02:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:02:20.750611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=2 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:02:21.369812 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf870f4-4f5b-4f49-a5e2-fd350e8ea904 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:21.370467 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf870f4-4f5b-4f49-a5e2-fd350e8ea904 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:21.370986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf870f4-4f5b-4f49-a5e2-fd350e8ea904 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:21.372559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 486/973] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:21.377669 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaef8e-900c-4505-a4a0-cd4da92ee67b None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:21.378138 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaef8e-900c-4505-a4a0-cd4da92ee67b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:21.378216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaef8e-900c-4505-a4a0-cd4da92ee67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:21.398724 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0bdaef8e-900c-4505-a4a0-cd4da92ee67b None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:21.399932 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0bdaef8e-900c-4505-a4a0-cd4da92ee67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:21.409273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 488/974] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:02:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:22.868169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef9b0-7e0f-407a-9ddd-67a245ff58e5 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:22.868752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef9b0-7e0f-407a-9ddd-67a245ff58e5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:22.868752 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef9b0-7e0f-407a-9ddd-67a245ff58e5 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:22.869961 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 487/975] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:22.875297 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d28c1-9672-450c-84c3-b3c9e73e8880 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:22.875735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d28c1-9672-450c-84c3-b3c9e73e8880 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:22.875849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d28c1-9672-450c-84c3-b3c9e73e8880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:22.896230 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b91d28c1-9672-450c-84c3-b3c9e73e8880 None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:22.897475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b91d28c1-9672-450c-84c3-b3c9e73e8880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:22.907240 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 489/976] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:02:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:26.880231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9257a-4f53-4981-b367-b173dade670d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:26.880744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9257a-4f53-4981-b367-b173dade670d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:26.880744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9257a-4f53-4981-b367-b173dade670d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:26.886964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 488/977] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:26.888306 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd7980-de02-41d2-a27a-3f33d9a19a68 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:26.888739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd7980-de02-41d2-a27a-3f33d9a19a68 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:26.888816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd7980-de02-41d2-a27a-3f33d9a19a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:26.912010 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-85cd7980-de02-41d2-a27a-3f33d9a19a68 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:26.913650 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-85cd7980-de02-41d2-a27a-3f33d9a19a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:26.923207 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 490/978] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:02:27.280109 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6892e59-b585-49ff-b83b-b5d14b7cc7af None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:27.280658 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6892e59-b585-49ff-b83b-b5d14b7cc7af None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:27.281284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6892e59-b585-49ff-b83b-b5d14b7cc7af None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:27.282848 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 489/979] 10.222.0.40 () {54 vars in 962 bytes} [Mon Aug 22 14:02:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:27.291649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e20c3-4a01-4f17-b512-426e2a95c4bb None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:27.292199 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e20c3-4a01-4f17-b512-426e2a95c4bb None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:27.292777 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e20c3-4a01-4f17-b512-426e2a95c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:27.337269 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-039e20c3-4a01-4f17-b512-426e2a95c4bb None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:27.338451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-039e20c3-4a01-4f17-b512-426e2a95c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:27.404748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:02:27.410849 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 491/980] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Aug 22 14:02:27 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:27.420125 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6892e59-b585-49ff-b83b-b5d14b7cc7af None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:27.436763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6892e59-b585-49ff-b83b-b5d14b7cc7af None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:27.441799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a00f-ef96-418c-abdb-edca226d0ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:27.442444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a00f-ef96-418c-abdb-edca226d0ff2 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:27.442693 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a00f-ef96-418c-abdb-edca226d0ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:27.443143 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a00f-ef96-418c-abdb-edca226d0ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:27.452259 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349a00f-ef96-418c-abdb-edca226d0ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:27.453885 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349a00f-ef96-418c-abdb-edca226d0ff2 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:27.463713 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 490/981] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:29.852105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852210c-4be6-4edd-94bb-d7f4411b5f4f None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:29.852629 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852210c-4be6-4edd-94bb-d7f4411b5f4f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:29.852629 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852210c-4be6-4edd-94bb-d7f4411b5f4f None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:29.854295 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 492/982] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:29.859806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ad7c-d47f-4748-862a-ac5a0ca3da75 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:29.860242 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ad7c-d47f-4748-862a-ac5a0ca3da75 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:29.860334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ad7c-d47f-4748-862a-ac5a0ca3da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:29.880453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-b3b3ad7c-d47f-4748-862a-ac5a0ca3da75 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:29.881659 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-b3b3ad7c-d47f-4748-862a-ac5a0ca3da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:29.901733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 491/983] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:30.237170 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852210c-4be6-4edd-94bb-d7f4411b5f4f None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:30.252297 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852210c-4be6-4edd-94bb-d7f4411b5f4f None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:30.258671 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7c259-3770-46fe-a5f2-8031de199517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:30.259393 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c259-3770-46fe-a5f2-8031de199517 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:30.259783 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c259-3770-46fe-a5f2-8031de199517 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:30.260156 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c259-3770-46fe-a5f2-8031de199517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:30.269842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7c259-3770-46fe-a5f2-8031de199517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:30.271576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7c259-3770-46fe-a5f2-8031de199517 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:30.282351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 493/984] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:32.880981 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea361-9a20-4d4f-8ed1-06ca714ead15 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:32.882025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea361-9a20-4d4f-8ed1-06ca714ead15 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:32.882230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea361-9a20-4d4f-8ed1-06ca714ead15 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:32.883646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 492/985] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:32.889100 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dac5ed-d2ef-41cd-b4e6-df9b8defedfd None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:32.889580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dac5ed-d2ef-41cd-b4e6-df9b8defedfd None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:32.889679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dac5ed-d2ef-41cd-b4e6-df9b8defedfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:32.910117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-98dac5ed-d2ef-41cd-b4e6-df9b8defedfd None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:32.911323 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-98dac5ed-d2ef-41cd-b4e6-df9b8defedfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:32.920410 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 494/986] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:33.268606 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1361ec-9889-443c-ac99-03b97fbd610c None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:33.268886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1361ec-9889-443c-ac99-03b97fbd610c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:33.269225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1361ec-9889-443c-ac99-03b97fbd610c None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:33.270979 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 493/987] 10.222.0.40 () {54 vars in 962 bytes} [Mon Aug 22 14:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:33.276482 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512f79-932f-418d-a369-523e85f536e2 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:33.276770 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512f79-932f-418d-a369-523e85f536e2 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:33.277046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512f79-932f-418d-a369-523e85f536e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:33.299923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-cd512f79-932f-418d-a369-523e85f536e2 None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:33.301110 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-cd512f79-932f-418d-a369-523e85f536e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:33.310726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 495/988] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Aug 22 14:02:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:33.321949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1361ec-9889-443c-ac99-03b97fbd610c None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:33.336232 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1361ec-9889-443c-ac99-03b97fbd610c None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:33.341628 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef8c7e-d399-4a7d-9db1-cfd882078637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:33.342234 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef8c7e-d399-4a7d-9db1-cfd882078637 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:33.342512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef8c7e-d399-4a7d-9db1-cfd882078637 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:33.342783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef8c7e-d399-4a7d-9db1-cfd882078637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:33.351505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef8c7e-d399-4a7d-9db1-cfd882078637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:33.353086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef8c7e-d399-4a7d-9db1-cfd882078637 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:33.364860 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 494/989] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:35.653136 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074fb84-8182-41eb-ad6f-9e2aae49660a None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:35.654049 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074fb84-8182-41eb-ad6f-9e2aae49660a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:35.654481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074fb84-8182-41eb-ad6f-9e2aae49660a None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:35.656225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 496/990] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:35.661856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749cdd-b147-497e-a339-4d4c599d8c3d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:35.662622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749cdd-b147-497e-a339-4d4c599d8c3d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:35.663038 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749cdd-b147-497e-a339-4d4c599d8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:35.683220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-33749cdd-b147-497e-a339-4d4c599d8c3d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:35.684678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-33749cdd-b147-497e-a339-4d4c599d8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:35.701533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 495/991] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:36.041607 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074fb84-8182-41eb-ad6f-9e2aae49660a None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:36.056288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074fb84-8182-41eb-ad6f-9e2aae49660a None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:36.061494 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12d319-83a5-4def-8d02-24853aa43b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:36.062275 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12d319-83a5-4def-8d02-24853aa43b67 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:36.062716 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12d319-83a5-4def-8d02-24853aa43b67 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:36.063135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12d319-83a5-4def-8d02-24853aa43b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:36.072957 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12d319-83a5-4def-8d02-24853aa43b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:36.074931 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12d319-83a5-4def-8d02-24853aa43b67 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:36.098578 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 497/992] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:37.215244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e853b11-5d17-4966-bccd-3f5f30ca2961 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:37.215822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e853b11-5d17-4966-bccd-3f5f30ca2961 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:37.215822 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e853b11-5d17-4966-bccd-3f5f30ca2961 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:37.217132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 496/993] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:37.222634 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c80f-ea10-491a-8abb-1b65a8dce272 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:37.223037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c80f-ea10-491a-8abb-1b65a8dce272 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:37.223170 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c80f-ea10-491a-8abb-1b65a8dce272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:37.245040 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-26a2c80f-ea10-491a-8abb-1b65a8dce272 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:37.246521 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-26a2c80f-ea10-491a-8abb-1b65a8dce272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:37.255480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 498/994] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:37.886811 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ce6d-49d3-468e-9c95-f86b755531ed None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:37.887323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ce6d-49d3-468e-9c95-f86b755531ed None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:37.887746 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ce6d-49d3-468e-9c95-f86b755531ed None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:37.889243 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 497/995] 10.222.0.40 () {54 vars in 964 bytes} [Mon Aug 22 14:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:37.894391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6873f5-8082-46d0-8a91-f9d36346e892 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:37.894841 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6873f5-8082-46d0-8a91-f9d36346e892 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:37.895282 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6873f5-8082-46d0-8a91-f9d36346e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:37.936378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-dd6873f5-8082-46d0-8a91-f9d36346e892 None None] MFA Rules not processed for user `2c40b1bbc4994db9a5c7a40c504a659a`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:37.937888 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-dd6873f5-8082-46d0-8a91-f9d36346e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:38.016789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 499/996] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Aug 22 14:02:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:38.024861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ce6d-49d3-468e-9c95-f86b755531ed None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:38.036711 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ce6d-49d3-468e-9c95-f86b755531ed None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:38.040588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcb467-8026-4d9e-8951-b09368a5fe38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c40b1bbc4994db9a5c7a40c504a659a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:38.041226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcb467-8026-4d9e-8951-b09368a5fe38 service cinder] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:38.041635 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcb467-8026-4d9e-8951-b09368a5fe38 service cinder] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:38.041886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcb467-8026-4d9e-8951-b09368a5fe38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:38.052064 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcb467-8026-4d9e-8951-b09368a5fe38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:38.053563 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcb467-8026-4d9e-8951-b09368a5fe38 service cinder] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:38.063883 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 498/997] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:38.410938 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82c0c-e376-4d4c-92e7-c5b864d11705 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:38.411510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82c0c-e376-4d4c-92e7-c5b864d11705 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:38.411510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82c0c-e376-4d4c-92e7-c5b864d11705 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:38.412803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 500/998] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:38.418424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd1e2-e48a-4f53-ae9d-52efff344775 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:38.418840 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd1e2-e48a-4f53-ae9d-52efff344775 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:38.418964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd1e2-e48a-4f53-ae9d-52efff344775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:38.440269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-5ffbd1e2-e48a-4f53-ae9d-52efff344775 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:38.441643 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-5ffbd1e2-e48a-4f53-ae9d-52efff344775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:38.449976 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 499/999] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:38.791974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82c0c-e376-4d4c-92e7-c5b864d11705 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:38.807638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82c0c-e376-4d4c-92e7-c5b864d11705 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:38.812781 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450cde3-381e-40ca-b8ca-e23e564a10aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:38.813588 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cde3-381e-40ca-b8ca-e23e564a10aa service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:38.814021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cde3-381e-40ca-b8ca-e23e564a10aa service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:38.814443 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cde3-381e-40ca-b8ca-e23e564a10aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:38.823960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450cde3-381e-40ca-b8ca-e23e564a10aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:38.825789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450cde3-381e-40ca-b8ca-e23e564a10aa service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:38.836915 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 501/1000] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:41.047149 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f609-10c5-4c67-ad76-ddab1d0962ec None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:41.048122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f609-10c5-4c67-ad76-ddab1d0962ec None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:41.048964 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f609-10c5-4c67-ad76-ddab1d0962ec None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:41.050552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 500/1001] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:41.056475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbbfbb-ed42-4043-bd9b-dfa629fbcab8 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:41.057004 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbbfbb-ed42-4043-bd9b-dfa629fbcab8 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:41.057096 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbbfbb-ed42-4043-bd9b-dfa629fbcab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:41.076965 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-bdfbbfbb-ed42-4043-bd9b-dfa629fbcab8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:41.078176 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-bdfbbfbb-ed42-4043-bd9b-dfa629fbcab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:41.087002 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 502/1002] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:41.433744 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f609-10c5-4c67-ad76-ddab1d0962ec None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:41.447639 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f609-10c5-4c67-ad76-ddab1d0962ec None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:41.452689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6528baf-e2cf-40e1-930b-111e95831a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:41.453262 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6528baf-e2cf-40e1-930b-111e95831a56 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:41.453540 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6528baf-e2cf-40e1-930b-111e95831a56 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:41.453806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6528baf-e2cf-40e1-930b-111e95831a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:41.462235 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6528baf-e2cf-40e1-930b-111e95831a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:41.463813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6528baf-e2cf-40e1-930b-111e95831a56 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:41.473044 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 501/1003] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:43.684348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513779c-a99c-41cd-aeb1-87d90007685a None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:43.684882 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513779c-a99c-41cd-aeb1-87d90007685a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:43.684882 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513779c-a99c-41cd-aeb1-87d90007685a None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:43.686369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 503/1004] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:43.691892 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc8f54-dbb0-4c32-bc0e-2bb4c9cfd62d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:43.692329 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc8f54-dbb0-4c32-bc0e-2bb4c9cfd62d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:43.692410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc8f54-dbb0-4c32-bc0e-2bb4c9cfd62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:43.714092 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a4fc8f54-dbb0-4c32-bc0e-2bb4c9cfd62d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:43.715267 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a4fc8f54-dbb0-4c32-bc0e-2bb4c9cfd62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:43.723713 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 502/1005] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:44.068987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513779c-a99c-41cd-aeb1-87d90007685a None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:44.083901 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513779c-a99c-41cd-aeb1-87d90007685a None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:44.089496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95b0f-5b49-4870-bd7a-61b5ce4acb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:44.090209 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95b0f-5b49-4870-bd7a-61b5ce4acb3f service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:44.090590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95b0f-5b49-4870-bd7a-61b5ce4acb3f service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:44.090978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95b0f-5b49-4870-bd7a-61b5ce4acb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:44.100167 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95b0f-5b49-4870-bd7a-61b5ce4acb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:44.102700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95b0f-5b49-4870-bd7a-61b5ce4acb3f service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:44.113516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 504/1006] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:46.302996 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895a5f-c065-48bf-ad52-4f6bc453b373 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:46.303560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895a5f-c065-48bf-ad52-4f6bc453b373 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:46.303560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895a5f-c065-48bf-ad52-4f6bc453b373 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:46.305059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 503/1007] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:46.310877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463707f-e9ac-4177-9205-e4626de07ffc None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:46.311303 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463707f-e9ac-4177-9205-e4626de07ffc None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:46.311447 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463707f-e9ac-4177-9205-e4626de07ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:46.332120 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-8463707f-e9ac-4177-9205-e4626de07ffc None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:46.333384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-8463707f-e9ac-4177-9205-e4626de07ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:46.341993 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 505/1008] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:46.701217 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895a5f-c065-48bf-ad52-4f6bc453b373 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:46.715986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895a5f-c065-48bf-ad52-4f6bc453b373 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:46.721953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59020dcf-18a9-4a4a-af94-053fa623f3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:46.722565 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59020dcf-18a9-4a4a-af94-053fa623f3a8 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:46.722846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59020dcf-18a9-4a4a-af94-053fa623f3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:46.723116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59020dcf-18a9-4a4a-af94-053fa623f3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:46.732588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59020dcf-18a9-4a4a-af94-053fa623f3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:46.734360 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59020dcf-18a9-4a4a-af94-053fa623f3a8 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:46.744882 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 504/1009] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:49.561104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa589c-b266-49a9-a483-17453d7b69a9 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:49.561104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa589c-b266-49a9-a483-17453d7b69a9 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:49.561104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa589c-b266-49a9-a483-17453d7b69a9 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:49.562902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 506/1010] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:49.576580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e132d6-b899-4c60-aa8f-76675c30c59f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:49.576580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e132d6-b899-4c60-aa8f-76675c30c59f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:49.577579 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e132d6-b899-4c60-aa8f-76675c30c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:49.602843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-00e132d6-b899-4c60-aa8f-76675c30c59f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:49.604746 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-00e132d6-b899-4c60-aa8f-76675c30c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:49.615239 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 505/1011] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:50.063909 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa589c-b266-49a9-a483-17453d7b69a9 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:50.080780 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa589c-b266-49a9-a483-17453d7b69a9 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:50.087590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00517b37-b8c3-4bc4-b25c-ccd4c07053ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:50.088371 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00517b37-b8c3-4bc4-b25c-ccd4c07053ac service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:50.089030 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00517b37-b8c3-4bc4-b25c-ccd4c07053ac service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:50.089501 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00517b37-b8c3-4bc4-b25c-ccd4c07053ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:50.100552 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00517b37-b8c3-4bc4-b25c-ccd4c07053ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:50.102932 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00517b37-b8c3-4bc4-b25c-ccd4c07053ac service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:50.114926 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 507/1012] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:53.063240 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7ef8-d962-4d61-8e05-a39fff98e00d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:53.063913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7ef8-d962-4d61-8e05-a39fff98e00d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:53.063913 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7ef8-d962-4d61-8e05-a39fff98e00d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:53.065638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 506/1013] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:53.070958 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c47e-a331-4f18-b96e-48a901271077 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:53.071446 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c47e-a331-4f18-b96e-48a901271077 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:53.071548 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c47e-a331-4f18-b96e-48a901271077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:53.091735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-ce33c47e-a331-4f18-b96e-48a901271077 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:53.092952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-ce33c47e-a331-4f18-b96e-48a901271077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:53.102130 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 508/1014] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:53.439078 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7ef8-d962-4d61-8e05-a39fff98e00d None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:53.447818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=46 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:02:53.455819 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7ef8-d962-4d61-8e05-a39fff98e00d None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:53.461273 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5559a9-8108-40ce-8699-f590afb6fd02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:53.461888 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5559a9-8108-40ce-8699-f590afb6fd02 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:53.462167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5559a9-8108-40ce-8699-f590afb6fd02 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:53.462438 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5559a9-8108-40ce-8699-f590afb6fd02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:53.471014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5559a9-8108-40ce-8699-f590afb6fd02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:53.472608 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5559a9-8108-40ce-8699-f590afb6fd02 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:53.482185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 507/1015] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:54.165135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ad10-244e-4969-b008-8f3351b7b0d0 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:54.171184 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ad10-244e-4969-b008-8f3351b7b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:54.171184 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ad10-244e-4969-b008-8f3351b7b0d0 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:54.171184 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 509/1016] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:54.172542 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8c15-cefc-4d88-b178-a697f722b69e None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:54.173034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8c15-cefc-4d88-b178-a697f722b69e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:54.173034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8c15-cefc-4d88-b178-a697f722b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:54.193696 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-f74a8c15-cefc-4d88-b178-a697f722b69e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:54.194953 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-f74a8c15-cefc-4d88-b178-a697f722b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:54.204203 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 508/1017] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:54.567229 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc18f-0d0a-4cef-9916-91d7ceaac95e None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:54.567522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc18f-0d0a-4cef-9916-91d7ceaac95e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:54.567975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc18f-0d0a-4cef-9916-91d7ceaac95e None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:54.569509 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 510/1018] 10.222.0.40 () {54 vars in 967 bytes} [Mon Aug 22 14:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:54.574851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e87ef7-147d-43b5-a988-1d3b3f98391b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:54.575209 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e87ef7-147d-43b5-a988-1d3b3f98391b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:54.575573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e87ef7-147d-43b5-a988-1d3b3f98391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:54.622329 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-11e87ef7-147d-43b5-a988-1d3b3f98391b None None] MFA Rules not processed for user `4b0911dbafa3421baea46c2cf923a516`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:54.623567 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-11e87ef7-147d-43b5-a988-1d3b3f98391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:54.687738 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 509/1019] 10.222.0.40 () {58 vars in 1064 bytes} [Mon Aug 22 14:02:54 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:54.695295 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc18f-0d0a-4cef-9916-91d7ceaac95e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:54.706788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc18f-0d0a-4cef-9916-91d7ceaac95e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:54.710966 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f451aa-c03f-4c80-83f5-418252f48a34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0911dbafa3421baea46c2cf923a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:54.711565 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f451aa-c03f-4c80-83f5-418252f48a34 service glance] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:54.711846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f451aa-c03f-4c80-83f5-418252f48a34 service glance] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:54.712111 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f451aa-c03f-4c80-83f5-418252f48a34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:54.722510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f451aa-c03f-4c80-83f5-418252f48a34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:54.723987 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f451aa-c03f-4c80-83f5-418252f48a34 service glance] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:54.733887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 511/1020] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:55.685330 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3f3d1-0307-4c68-801d-92556537747c None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:55.686061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3f3d1-0307-4c68-801d-92556537747c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:55.686061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3f3d1-0307-4c68-801d-92556537747c None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:55.687168 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 510/1021] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:55.692793 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03ac5-5244-455d-9678-7b522144754a None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:55.693327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03ac5-5244-455d-9678-7b522144754a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:55.693327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03ac5-5244-455d-9678-7b522144754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:55.716407 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-1ba03ac5-5244-455d-9678-7b522144754a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:55.717753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-1ba03ac5-5244-455d-9678-7b522144754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:55.726159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 512/1022] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:56.070179 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3f3d1-0307-4c68-801d-92556537747c None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:56.085914 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3f3d1-0307-4c68-801d-92556537747c None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:56.091680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3e26-6a92-418c-b577-1be5236c19ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:56.092318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3e26-6a92-418c-b577-1be5236c19ac service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:56.092590 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3e26-6a92-418c-b577-1be5236c19ac service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:56.092856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3e26-6a92-418c-b577-1be5236c19ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:56.102370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3e26-6a92-418c-b577-1be5236c19ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:56.103972 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3e26-6a92-418c-b577-1be5236c19ac service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:56.117861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 511/1023] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:02:58.398430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d11fe-4d04-4aff-9dc8-b592456271d4 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:58.399183 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d11fe-4d04-4aff-9dc8-b592456271d4 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:58.399183 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d11fe-4d04-4aff-9dc8-b592456271d4 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:58.400317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 513/1024] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:02:58.405911 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420d39-52af-4140-8e64-8d227741c8f6 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:58.406422 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420d39-52af-4140-8e64-8d227741c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:58.406422 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420d39-52af-4140-8e64-8d227741c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:58.426832 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-09420d39-52af-4140-8e64-8d227741c8f6 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:02:58.428045 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-09420d39-52af-4140-8e64-8d227741c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:02:58.438188 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 512/1025] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:02:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:02:58.783262 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d11fe-4d04-4aff-9dc8-b592456271d4 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:02:58.791763 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=92 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:02:58.800730 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d11fe-4d04-4aff-9dc8-b592456271d4 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:02:58.806510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfde63f-060e-4fb8-b1e8-7d30fcfacdd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:02:58.807126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfde63f-060e-4fb8-b1e8-7d30fcfacdd8 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:02:58.807404 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfde63f-060e-4fb8-b1e8-7d30fcfacdd8 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:02:58.807675 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfde63f-060e-4fb8-b1e8-7d30fcfacdd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:02:58.818244 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfde63f-060e-4fb8-b1e8-7d30fcfacdd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:02:58.819928 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfde63f-060e-4fb8-b1e8-7d30fcfacdd8 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:02:58.829827 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 514/1026] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:02:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:08.421557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=50 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:03:08.825582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=5 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:03:10.534028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9872-2c33-491c-915e-4e8fa30f0452 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:10.534767 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9872-2c33-491c-915e-4e8fa30f0452 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:10.534767 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9872-2c33-491c-915e-4e8fa30f0452 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:10.536393 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 513/1027] 10.222.0.40 () {54 vars in 918 bytes} [Mon Aug 22 14:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:10.541886 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53c99-e975-4594-9ecb-c175225d0ddc None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:10.542341 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53c99-e975-4594-9ecb-c175225d0ddc None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:10.542441 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53c99-e975-4594-9ecb-c175225d0ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:10.564123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-edf53c99-e975-4594-9ecb-c175225d0ddc None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:10.565437 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-edf53c99-e975-4594-9ecb-c175225d0ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:10.575753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 515/1028] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Aug 22 14:03:10 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:10.590043 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfceea5-d6b8-4fae-baa6-379b43c6c1d6 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:10.590298 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfceea5-d6b8-4fae-baa6-379b43c6c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:10.590609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfceea5-d6b8-4fae-baa6-379b43c6c1d6 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:10.591922 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 514/1029] 10.222.0.40 () {54 vars in 918 bytes} [Mon Aug 22 14:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:10.596536 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b3dbd-18f4-4667-bc6b-2bc474448603 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:10.596866 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b3dbd-18f4-4667-bc6b-2bc474448603 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:10.597135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b3dbd-18f4-4667-bc6b-2bc474448603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:10.616806 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-dd6b3dbd-18f4-4667-bc6b-2bc474448603 None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:10.618054 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-dd6b3dbd-18f4-4667-bc6b-2bc474448603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:10.628152 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 516/1030] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Aug 22 14:03:10 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:13.315170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632719-ad93-43c4-8be5-e1221caa977d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:13.315813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632719-ad93-43c4-8be5-e1221caa977d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:13.315813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632719-ad93-43c4-8be5-e1221caa977d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:13.317582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:13.325518 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59689-ba6d-497c-a2d5-ddf921355d2a None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:13.326031 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59689-ba6d-497c-a2d5-ddf921355d2a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:13.326031 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59689-ba6d-497c-a2d5-ddf921355d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:13.346160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6ba59689-ba6d-497c-a2d5-ddf921355d2a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:13.347365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6ba59689-ba6d-497c-a2d5-ddf921355d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:13.355625 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:03:13.700958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632719-ad93-43c4-8be5-e1221caa977d None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:13.715535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632719-ad93-43c4-8be5-e1221caa977d None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:13.720949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501a4c-aa58-4b75-810e-0ce176ce3754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:13.721861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501a4c-aa58-4b75-810e-0ce176ce3754 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:13.722141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501a4c-aa58-4b75-810e-0ce176ce3754 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:13.722409 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501a4c-aa58-4b75-810e-0ce176ce3754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:13.731367 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501a4c-aa58-4b75-810e-0ce176ce3754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:13.732951 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501a4c-aa58-4b75-810e-0ce176ce3754 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:13.742737 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 516/1033] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:14.698998 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b712d0a-fcd7-4831-a928-feb0fb4a1220 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:14.699752 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b712d0a-fcd7-4831-a928-feb0fb4a1220 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:14.699928 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b712d0a-fcd7-4831-a928-feb0fb4a1220 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:14.702109 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:14.710460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518cc8-68a7-4378-864f-6e0938b7f97d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:14.710904 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518cc8-68a7-4378-864f-6e0938b7f97d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:14.711051 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518cc8-68a7-4378-864f-6e0938b7f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:14.731100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-e6518cc8-68a7-4378-864f-6e0938b7f97d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:14.732352 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-e6518cc8-68a7-4378-864f-6e0938b7f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:14.741217 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:15.003314 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b712d0a-fcd7-4831-a928-feb0fb4a1220 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:15.018485 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b712d0a-fcd7-4831-a928-feb0fb4a1220 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:15.027024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310ff0-7b44-4ecb-987d-acbb8738dfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:15.027624 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310ff0-7b44-4ecb-987d-acbb8738dfec service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:15.027900 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310ff0-7b44-4ecb-987d-acbb8738dfec service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:15.028194 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310ff0-7b44-4ecb-987d-acbb8738dfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:15.039273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310ff0-7b44-4ecb-987d-acbb8738dfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:15.040877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310ff0-7b44-4ecb-987d-acbb8738dfec service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:15.051235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 519/1036] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:15.943916 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7095-9daa-4afa-9488-be345b62406f None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:15.944513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7095-9daa-4afa-9488-be345b62406f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:15.944513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7095-9daa-4afa-9488-be345b62406f None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:15.945908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:15.951915 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863179-f268-4c0a-acd0-f762581f2607 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:15.952666 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863179-f268-4c0a-acd0-f762581f2607 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:15.952833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863179-f268-4c0a-acd0-f762581f2607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:15.981794 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-f0863179-f268-4c0a-acd0-f762581f2607 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:15.982996 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-f0863179-f268-4c0a-acd0-f762581f2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:15.991994 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:16.150553 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7095-9daa-4afa-9488-be345b62406f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:16.173071 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7095-9daa-4afa-9488-be345b62406f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:16.180518 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e274d55-6c54-47cf-b577-fa2af9883934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:16.181120 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e274d55-6c54-47cf-b577-fa2af9883934 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:16.181419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e274d55-6c54-47cf-b577-fa2af9883934 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:16.181693 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e274d55-6c54-47cf-b577-fa2af9883934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:16.189821 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e274d55-6c54-47cf-b577-fa2af9883934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:16.191432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e274d55-6c54-47cf-b577-fa2af9883934 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:16.200647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 519/1039] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:17.065383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12328d-f34d-426f-a4ff-aa07945d1cf8 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:17.065983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12328d-f34d-426f-a4ff-aa07945d1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:17.065983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12328d-f34d-426f-a4ff-aa07945d1cf8 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:17.067239 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:17.073334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15686dc5-b0e2-4949-b31b-34048dd5e874 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:17.073755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15686dc5-b0e2-4949-b31b-34048dd5e874 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:17.073934 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15686dc5-b0e2-4949-b31b-34048dd5e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:17.098463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-15686dc5-b0e2-4949-b31b-34048dd5e874 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:17.099682 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-15686dc5-b0e2-4949-b31b-34048dd5e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:17.108666 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:17.264628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12328d-f34d-426f-a4ff-aa07945d1cf8 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:17.280400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12328d-f34d-426f-a4ff-aa07945d1cf8 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:17.286674 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e97dd-45d0-4874-ac44-edd9ad3063b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:17.287270 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e97dd-45d0-4874-ac44-edd9ad3063b0 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:17.287545 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e97dd-45d0-4874-ac44-edd9ad3063b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:17.287817 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e97dd-45d0-4874-ac44-edd9ad3063b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:17.296636 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e97dd-45d0-4874-ac44-edd9ad3063b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:17.298300 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e97dd-45d0-4874-ac44-edd9ad3063b0 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:17.308616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 522/1042] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:18.176827 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc71d-8a20-4a34-811a-9e7164c12c79 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:18.177424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc71d-8a20-4a34-811a-9e7164c12c79 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:18.177424 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc71d-8a20-4a34-811a-9e7164c12c79 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:18.179176 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:18.184615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3112cd-95dd-4907-8ec1-467bc4da60d3 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:18.185082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3112cd-95dd-4907-8ec1-467bc4da60d3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:18.185211 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3112cd-95dd-4907-8ec1-467bc4da60d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:18.206140 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-cd3112cd-95dd-4907-8ec1-467bc4da60d3 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:18.207377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-cd3112cd-95dd-4907-8ec1-467bc4da60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:18.217874 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:18.376971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc71d-8a20-4a34-811a-9e7164c12c79 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:18.391990 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc71d-8a20-4a34-811a-9e7164c12c79 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:18.397009 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9582e09-611c-4cec-ba33-874bb9b57738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:18.397629 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9582e09-611c-4cec-ba33-874bb9b57738 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:18.398062 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9582e09-611c-4cec-ba33-874bb9b57738 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:18.398331 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9582e09-611c-4cec-ba33-874bb9b57738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:18.406281 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9582e09-611c-4cec-ba33-874bb9b57738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:18.407850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9582e09-611c-4cec-ba33-874bb9b57738 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:18.417056 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 522/1045] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:19.212424 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6628c3-88f0-45c8-ba04-4b9da7bfa1af None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:19.212991 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6628c3-88f0-45c8-ba04-4b9da7bfa1af None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:19.212991 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6628c3-88f0-45c8-ba04-4b9da7bfa1af None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:19.214327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:19.220175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5776f-82eb-4e23-bb3c-67cd7f535829 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:19.220886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5776f-82eb-4e23-bb3c-67cd7f535829 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:19.221052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5776f-82eb-4e23-bb3c-67cd7f535829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:19.243736 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d1d5776f-82eb-4e23-bb3c-67cd7f535829 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:19.244975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d1d5776f-82eb-4e23-bb3c-67cd7f535829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:19.254229 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:19.410310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6628c3-88f0-45c8-ba04-4b9da7bfa1af None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:19.427887 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6628c3-88f0-45c8-ba04-4b9da7bfa1af None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:19.437241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba390ef-ec3d-492c-9806-3a6f86f5bb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:19.438113 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba390ef-ec3d-492c-9806-3a6f86f5bb1a service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:19.438417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba390ef-ec3d-492c-9806-3a6f86f5bb1a service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:19.438705 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba390ef-ec3d-492c-9806-3a6f86f5bb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:19.448481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba390ef-ec3d-492c-9806-3a6f86f5bb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:19.450133 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba390ef-ec3d-492c-9806-3a6f86f5bb1a service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:19.460255 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 525/1048] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:20.283533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc3bd-adc8-4da4-9a70-b0d60196e204 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:20.284272 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc3bd-adc8-4da4-9a70-b0d60196e204 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:20.284272 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc3bd-adc8-4da4-9a70-b0d60196e204 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:20.286174 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:20.291346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d89b0-ed3a-48bd-be43-5d7ffafcd01a None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:20.291784 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d89b0-ed3a-48bd-be43-5d7ffafcd01a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:20.291881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d89b0-ed3a-48bd-be43-5d7ffafcd01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:20.314382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6d6d89b0-ed3a-48bd-be43-5d7ffafcd01a None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:20.315601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6d6d89b0-ed3a-48bd-be43-5d7ffafcd01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:20.325126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:20.483753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcc3bd-adc8-4da4-9a70-b0d60196e204 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:20.501622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcc3bd-adc8-4da4-9a70-b0d60196e204 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:20.507494 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b1b1d-1b9d-4678-8202-18d471d32dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:20.508091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b1b1d-1b9d-4678-8202-18d471d32dce service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:20.508372 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b1b1d-1b9d-4678-8202-18d471d32dce service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:20.508609 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b1b1d-1b9d-4678-8202-18d471d32dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:20.517177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b1b1d-1b9d-4678-8202-18d471d32dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:20.518843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b1b1d-1b9d-4678-8202-18d471d32dce service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:20.528637 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 525/1051] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:21.332988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c325-0d0c-41f8-b649-3d9e15aaff12 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:21.334000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c325-0d0c-41f8-b649-3d9e15aaff12 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:21.334000 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c325-0d0c-41f8-b649-3d9e15aaff12 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:21.335977 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:21.342048 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d007d7-eb0f-4d1c-97fa-d0178733a317 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:21.342495 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d007d7-eb0f-4d1c-97fa-d0178733a317 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:21.342619 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d007d7-eb0f-4d1c-97fa-d0178733a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:21.370792 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-b1d007d7-eb0f-4d1c-97fa-d0178733a317 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:21.372000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-b1d007d7-eb0f-4d1c-97fa-d0178733a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:21.380531 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:21.538197 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c325-0d0c-41f8-b649-3d9e15aaff12 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:21.556478 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c325-0d0c-41f8-b649-3d9e15aaff12 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:21.562472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f9dc-fdad-4814-9bdc-1c3c0312302e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:21.563079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f9dc-fdad-4814-9bdc-1c3c0312302e service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:21.563354 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f9dc-fdad-4814-9bdc-1c3c0312302e service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:21.563632 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f9dc-fdad-4814-9bdc-1c3c0312302e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:21.572705 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f9dc-fdad-4814-9bdc-1c3c0312302e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:21.574405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f9dc-fdad-4814-9bdc-1c3c0312302e service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:21.584782 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 528/1054] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:22.412101 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1352-b78e-4071-b372-35329425460c None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:22.412957 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1352-b78e-4071-b372-35329425460c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:22.412957 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1352-b78e-4071-b372-35329425460c None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:22.414519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:22.421865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3223e-eb97-4019-b4e1-0cfe03e3cabb None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:22.422341 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3223e-eb97-4019-b4e1-0cfe03e3cabb None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:22.422445 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3223e-eb97-4019-b4e1-0cfe03e3cabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:22.444009 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-baa3223e-eb97-4019-b4e1-0cfe03e3cabb None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:22.445354 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-baa3223e-eb97-4019-b4e1-0cfe03e3cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:22.453622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:03:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:03:22.614907 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1352-b78e-4071-b372-35329425460c None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:22.630805 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1352-b78e-4071-b372-35329425460c None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:22.637177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0b9ec-8850-4115-a04a-f4c87730a64c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:22.637792 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0b9ec-8850-4115-a04a-f4c87730a64c service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:22.638063 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0b9ec-8850-4115-a04a-f4c87730a64c service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:22.638336 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0b9ec-8850-4115-a04a-f4c87730a64c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:22.647412 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0b9ec-8850-4115-a04a-f4c87730a64c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:22.649891 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0b9ec-8850-4115-a04a-f4c87730a64c service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:22.665411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 528/1057] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:24.729468 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35fd46-64a4-419a-83fd-90f87e589ed1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:24.730116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35fd46-64a4-419a-83fd-90f87e589ed1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:24.730116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35fd46-64a4-419a-83fd-90f87e589ed1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:24.731352 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 14:03:24.738278 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdaa6c-0a80-4b0f-875e-da10a508f395 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:24.739014 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdaa6c-0a80-4b0f-875e-da10a508f395 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:24.739206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdaa6c-0a80-4b0f-875e-da10a508f395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:24.766793 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-82fdaa6c-0a80-4b0f-875e-da10a508f395 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:24.768016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-82fdaa6c-0a80-4b0f-875e-da10a508f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:24.777268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:25.115771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35fd46-64a4-419a-83fd-90f87e589ed1 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:25.130227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35fd46-64a4-419a-83fd-90f87e589ed1 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:25.136948 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3f98-fc8c-49b1-8ed6-37dfdf65fa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:25.137717 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3f98-fc8c-49b1-8ed6-37dfdf65fa13 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:25.138052 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3f98-fc8c-49b1-8ed6-37dfdf65fa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:25.138411 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3f98-fc8c-49b1-8ed6-37dfdf65fa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:25.150503 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f3f98-fc8c-49b1-8ed6-37dfdf65fa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:25.151956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f3f98-fc8c-49b1-8ed6-37dfdf65fa13 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:25.162005 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 531/1060] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:27.539973 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596ceb2-6f10-4d4d-a360-c8f70e609c5f None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:27.540908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596ceb2-6f10-4d4d-a360-c8f70e609c5f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:27.540908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596ceb2-6f10-4d4d-a360-c8f70e609c5f None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:27.543088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:27.552156 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34439-e97c-43f5-a981-c0301bae7320 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:27.552594 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34439-e97c-43f5-a981-c0301bae7320 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:27.552756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34439-e97c-43f5-a981-c0301bae7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:27.575143 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-98b34439-e97c-43f5-a981-c0301bae7320 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:27.576423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-98b34439-e97c-43f5-a981-c0301bae7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:27.586481 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:27.942091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596ceb2-6f10-4d4d-a360-c8f70e609c5f None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:27.955000 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596ceb2-6f10-4d4d-a360-c8f70e609c5f None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:27.958917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdefc-9849-4cb7-8ad7-9e92c88330a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:27.959511 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdefc-9849-4cb7-8ad7-9e92c88330a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:27.959785 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdefc-9849-4cb7-8ad7-9e92c88330a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:27.960052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdefc-9849-4cb7-8ad7-9e92c88330a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:27.970018 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cdefc-9849-4cb7-8ad7-9e92c88330a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:27.971441 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cdefc-9849-4cb7-8ad7-9e92c88330a5 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:27.981317 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 531/1063] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:30.587069 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062551-11e9-437b-9833-f290d19b03ee None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:30.587638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062551-11e9-437b-9833-f290d19b03ee None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:30.587638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062551-11e9-437b-9833-f290d19b03ee None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:30.589076 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:30.594559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d29b-7b98-4754-b23a-f72b46a38a36 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:30.594998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d29b-7b98-4754-b23a-f72b46a38a36 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:30.595095 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d29b-7b98-4754-b23a-f72b46a38a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:30.616664 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-19d7d29b-7b98-4754-b23a-f72b46a38a36 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:30.617925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-19d7d29b-7b98-4754-b23a-f72b46a38a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:30.629763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:30.970472 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062551-11e9-437b-9833-f290d19b03ee None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:30.990735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062551-11e9-437b-9833-f290d19b03ee None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:30.995664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e017bc-dee1-43f9-bfde-6f721f16c7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:30.996297 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e017bc-dee1-43f9-bfde-6f721f16c7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:30.996574 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e017bc-dee1-43f9-bfde-6f721f16c7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:30.996845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e017bc-dee1-43f9-bfde-6f721f16c7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:31.009263 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e017bc-dee1-43f9-bfde-6f721f16c7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:31.010762 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e017bc-dee1-43f9-bfde-6f721f16c7e7 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:31.020384 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 534/1066] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:33.347626 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe0b4f-ff15-4b6c-b7f6-48240623bb7c None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:33.348618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe0b4f-ff15-4b6c-b7f6-48240623bb7c None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:33.348618 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe0b4f-ff15-4b6c-b7f6-48240623bb7c None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:33.351135 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:33.356645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327c59-4079-4535-80e5-88c4fcb1ab78 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:33.357138 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327c59-4079-4535-80e5-88c4fcb1ab78 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:33.357138 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327c59-4079-4535-80e5-88c4fcb1ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:33.376699 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-38327c59-4079-4535-80e5-88c4fcb1ab78 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:33.378034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-38327c59-4079-4535-80e5-88c4fcb1ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:33.386230 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:33.724602 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe0b4f-ff15-4b6c-b7f6-48240623bb7c None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:33.738491 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe0b4f-ff15-4b6c-b7f6-48240623bb7c None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:33.743253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa08e-9c8c-4253-b970-5163cd2fef25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:33.743850 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa08e-9c8c-4253-b970-5163cd2fef25 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:33.744124 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa08e-9c8c-4253-b970-5163cd2fef25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:33.744391 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa08e-9c8c-4253-b970-5163cd2fef25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:33.753761 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa08e-9c8c-4253-b970-5163cd2fef25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:33.755186 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa08e-9c8c-4253-b970-5163cd2fef25 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:33.764632 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 534/1069] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:35.981601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3c33-040e-471f-98d5-094980520693 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:35.982160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3c33-040e-471f-98d5-094980520693 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:35.982160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3c33-040e-471f-98d5-094980520693 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:35.983490 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:35.990015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2835cf-564b-45e6-9832-950e1ee4cc27 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:35.990480 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2835cf-564b-45e6-9832-950e1ee4cc27 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:35.990675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2835cf-564b-45e6-9832-950e1ee4cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:36.012492 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-0c2835cf-564b-45e6-9832-950e1ee4cc27 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:36.013754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-0c2835cf-564b-45e6-9832-950e1ee4cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:36.023028 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:36.365628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3c33-040e-471f-98d5-094980520693 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:36.384222 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3c33-040e-471f-98d5-094980520693 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:36.388250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68943-d030-4b1c-a6e2-22c04570c45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:36.388841 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68943-d030-4b1c-a6e2-22c04570c45d service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:36.389114 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68943-d030-4b1c-a6e2-22c04570c45d service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:36.389407 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68943-d030-4b1c-a6e2-22c04570c45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:36.399785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d68943-d030-4b1c-a6e2-22c04570c45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:36.401977 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d68943-d030-4b1c-a6e2-22c04570c45d service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:36.416146 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 537/1072] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:38.769711 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f805-0402-4f61-90c8-54147f27ddd8 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:38.770288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f805-0402-4f61-90c8-54147f27ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:38.770288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f805-0402-4f61-90c8-54147f27ddd8 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:38.772279 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:38.778116 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b904f-4a82-4110-8ff0-129c9ceec747 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:38.778569 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b904f-4a82-4110-8ff0-129c9ceec747 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:38.778660 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b904f-4a82-4110-8ff0-129c9ceec747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:38.799310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-466b904f-4a82-4110-8ff0-129c9ceec747 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:38.800488 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-466b904f-4a82-4110-8ff0-129c9ceec747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:38.808836 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:03:39.151833 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4f805-0402-4f61-90c8-54147f27ddd8 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:39.157960 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=64 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:03:39.165019 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4f805-0402-4f61-90c8-54147f27ddd8 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:39.168906 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc92db-4e78-44ea-9082-43593078fc3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:39.169506 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc92db-4e78-44ea-9082-43593078fc3a service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:39.169784 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc92db-4e78-44ea-9082-43593078fc3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:39.170050 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc92db-4e78-44ea-9082-43593078fc3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:39.179462 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc92db-4e78-44ea-9082-43593078fc3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:39.180891 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc92db-4e78-44ea-9082-43593078fc3a service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:39.190411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 537/1075] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:41.379743 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca287e-e93f-4086-9aa5-0075ead2aca1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:41.381048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca287e-e93f-4086-9aa5-0075ead2aca1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:41.381048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca287e-e93f-4086-9aa5-0075ead2aca1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:41.381679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:41.389025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb810f-a512-4e37-ab10-b010667fa6b8 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:41.389845 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb810f-a512-4e37-ab10-b010667fa6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:41.390026 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb810f-a512-4e37-ab10-b010667fa6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:41.413256 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-aebb810f-a512-4e37-ab10-b010667fa6b8 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:41.414497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-aebb810f-a512-4e37-ab10-b010667fa6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:41.423944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:41.760832 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca287e-e93f-4086-9aa5-0075ead2aca1 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:41.767046 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=73 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:03:41.773650 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca287e-e93f-4086-9aa5-0075ead2aca1 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:41.777493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34163-ceec-4056-9189-56ccd39cd3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:41.778085 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34163-ceec-4056-9189-56ccd39cd3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:41.778355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34163-ceec-4056-9189-56ccd39cd3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:41.778618 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34163-ceec-4056-9189-56ccd39cd3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:41.787838 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34163-ceec-4056-9189-56ccd39cd3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:41.789339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34163-ceec-4056-9189-56ccd39cd3e3 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:41.798947 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 540/1078] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:43.994167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569108f-ee62-4bd0-9d2f-327a1b77cbfa None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:43.995097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569108f-ee62-4bd0-9d2f-327a1b77cbfa None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:43.995097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569108f-ee62-4bd0-9d2f-327a1b77cbfa None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:43.997212 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:44.005796 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3cd26-9d27-4f64-bf99-703eda5dbd3d None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:44.006245 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3cd26-9d27-4f64-bf99-703eda5dbd3d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:44.006355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3cd26-9d27-4f64-bf99-703eda5dbd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:44.027572 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-7af3cd26-9d27-4f64-bf99-703eda5dbd3d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:44.028787 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-7af3cd26-9d27-4f64-bf99-703eda5dbd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:44.039265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:44.381328 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569108f-ee62-4bd0-9d2f-327a1b77cbfa None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:44.394464 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569108f-ee62-4bd0-9d2f-327a1b77cbfa None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:44.398919 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d449ce-a15a-4cde-83c5-6e6a78ab365b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:44.399580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d449ce-a15a-4cde-83c5-6e6a78ab365b service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:44.399861 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d449ce-a15a-4cde-83c5-6e6a78ab365b service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:44.400134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d449ce-a15a-4cde-83c5-6e6a78ab365b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:44.409879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d449ce-a15a-4cde-83c5-6e6a78ab365b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:44.411315 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d449ce-a15a-4cde-83c5-6e6a78ab365b service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:44.421404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 540/1081] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:46.686868 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3c53-9ae4-4e40-b05f-8ee442cefc4d None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:46.687471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3c53-9ae4-4e40-b05f-8ee442cefc4d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:46.687471 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c3c53-9ae4-4e40-b05f-8ee442cefc4d None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:46.688736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 14:03:46.695396 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ac4c5-0b3b-46ff-90c7-4928ad462801 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:46.695879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ac4c5-0b3b-46ff-90c7-4928ad462801 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:46.695989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ac4c5-0b3b-46ff-90c7-4928ad462801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:46.718007 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ea4ac4c5-0b3b-46ff-90c7-4928ad462801 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:46.719201 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ea4ac4c5-0b3b-46ff-90c7-4928ad462801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:46.729846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:47.061402 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3c53-9ae4-4e40-b05f-8ee442cefc4d None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:47.074558 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c3c53-9ae4-4e40-b05f-8ee442cefc4d None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:47.078860 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f566d-0b46-4e29-aba9-5a57a21c6f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:47.079474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f566d-0b46-4e29-aba9-5a57a21c6f16 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:47.079749 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f566d-0b46-4e29-aba9-5a57a21c6f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:47.080012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f566d-0b46-4e29-aba9-5a57a21c6f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:47.089871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f566d-0b46-4e29-aba9-5a57a21c6f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:47.091285 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f566d-0b46-4e29-aba9-5a57a21c6f16 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:47.101726 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 543/1084] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:49.305379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15a28-c037-4c55-a206-5441fec37091 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:49.305978 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15a28-c037-4c55-a206-5441fec37091 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:49.305978 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15a28-c037-4c55-a206-5441fec37091 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:49.307248 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:03:49.313811 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd2b7-3c21-4342-97c4-82a2ca72ee17 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:49.314595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd2b7-3c21-4342-97c4-82a2ca72ee17 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:49.314768 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd2b7-3c21-4342-97c4-82a2ca72ee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:49.337265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-b5fdd2b7-3c21-4342-97c4-82a2ca72ee17 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:03:49.338478 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-b5fdd2b7-3c21-4342-97c4-82a2ca72ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:03:49.347801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:03:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:03:49.692382 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15a28-c037-4c55-a206-5441fec37091 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:03:49.711362 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15a28-c037-4c55-a206-5441fec37091 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:03:49.715152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaea76-0a09-42fa-8e88-b47819cef492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:03:49.715748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaea76-0a09-42fa-8e88-b47819cef492 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:03:49.716027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaea76-0a09-42fa-8e88-b47819cef492 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:03:49.716294 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaea76-0a09-42fa-8e88-b47819cef492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:03:49.725920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaea76-0a09-42fa-8e88-b47819cef492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:03:49.727373 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaea76-0a09-42fa-8e88-b47819cef492 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:03:49.736860 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 543/1087] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:03:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:03:59.332195 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=17 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:03:59.732630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=23 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:04:13.526601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815513-38e8-4d0b-b33d-66e0c11a73e9 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:13.527248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815513-38e8-4d0b-b33d-66e0c11a73e9 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:13.527248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815513-38e8-4d0b-b33d-66e0c11a73e9 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:13.528465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 545/1088] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:13.535020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979ff9-8df8-463d-b192-1a4e37533cf4 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:13.535851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979ff9-8df8-463d-b192-1a4e37533cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:13.536023 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979ff9-8df8-463d-b192-1a4e37533cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:13.557361 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-e0979ff9-8df8-463d-b192-1a4e37533cf4 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:13.558696 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-e0979ff9-8df8-463d-b192-1a4e37533cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:13.569078 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 544/1089] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:13.933565 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cca3a-28cc-4749-aadf-7d32faf4ff0b None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:13.933852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cca3a-28cc-4749-aadf-7d32faf4ff0b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:13.934129 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cca3a-28cc-4749-aadf-7d32faf4ff0b None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:13.935524 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 546/1090] 10.222.0.40 () {54 vars in 967 bytes} [Mon Aug 22 14:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:13.941774 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aa89a-9146-400c-bcfe-cfb25b319815 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:13.942066 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aa89a-9146-400c-bcfe-cfb25b319815 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:13.942332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aa89a-9146-400c-bcfe-cfb25b319815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:13.969171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-868aa89a-9146-400c-bcfe-cfb25b319815 None None] MFA Rules not processed for user `4b0911dbafa3421baea46c2cf923a516`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:13.970427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-868aa89a-9146-400c-bcfe-cfb25b319815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:13.978917 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 545/1091] 10.222.0.40 () {58 vars in 1064 bytes} [Mon Aug 22 14:04:13 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:13.990265 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cca3a-28cc-4749-aadf-7d32faf4ff0b None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:14.003102 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cca3a-28cc-4749-aadf-7d32faf4ff0b None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:14.007155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2f4fc-c174-4088-ae4c-c3e2a546afd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0911dbafa3421baea46c2cf923a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:14.007744 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2f4fc-c174-4088-ae4c-c3e2a546afd9 service glance] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:14.008018 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2f4fc-c174-4088-ae4c-c3e2a546afd9 service glance] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:14.008288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2f4fc-c174-4088-ae4c-c3e2a546afd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:14.017461 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2f4fc-c174-4088-ae4c-c3e2a546afd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:14.018892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2f4fc-c174-4088-ae4c-c3e2a546afd9 service glance] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:14.028380 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 547/1092] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:04:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:04:16.283720 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117c725-fee3-43b0-9ec6-b55a413c6402 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:16.284622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117c725-fee3-43b0-9ec6-b55a413c6402 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:16.284622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117c725-fee3-43b0-9ec6-b55a413c6402 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:16.286576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 546/1093] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:16.293107 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57193-1ad5-47fa-89e6-3359ecc8f98f None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:16.293903 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57193-1ad5-47fa-89e6-3359ecc8f98f None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:16.294064 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57193-1ad5-47fa-89e6-3359ecc8f98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:16.318809 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-7cd57193-1ad5-47fa-89e6-3359ecc8f98f None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:16.319985 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-7cd57193-1ad5-47fa-89e6-3359ecc8f98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:16.329398 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 548/1094] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:16.653923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117c725-fee3-43b0-9ec6-b55a413c6402 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:16.668829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117c725-fee3-43b0-9ec6-b55a413c6402 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:16.675032 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:16.675624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:16.675898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:16.676185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:16.676798 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:16.678574 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:04:16.678574 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:04:16.678574 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:04:16.679766 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ad28d-f249-4e05-ac2a-039eb1a8e50f admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:16.698757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 547/1095] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Aug 22 14:04:16 2022] GET /identity/v3/projects => generated 1606 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:04:18.872030 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddae363-f526-4fc9-82aa-40bc9cef23b1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:18.872867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddae363-f526-4fc9-82aa-40bc9cef23b1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:18.872867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddae363-f526-4fc9-82aa-40bc9cef23b1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:18.875200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 549/1096] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:18.881436 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ee8f-cf72-4230-a83d-7e04dedab67d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:18.882222 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ee8f-cf72-4230-a83d-7e04dedab67d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:18.882644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ee8f-cf72-4230-a83d-7e04dedab67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:18.902404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d834ee8f-cf72-4230-a83d-7e04dedab67d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:18.903614 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d834ee8f-cf72-4230-a83d-7e04dedab67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:18.912119 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 548/1097] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:19.272172 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddae363-f526-4fc9-82aa-40bc9cef23b1 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:19.287484 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddae363-f526-4fc9-82aa-40bc9cef23b1 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:19.294997 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4805b5-50be-4f70-b446-470ea0a30cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:19.295897 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4805b5-50be-4f70-b446-470ea0a30cc3 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:19.296309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4805b5-50be-4f70-b446-470ea0a30cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:19.296713 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4805b5-50be-4f70-b446-470ea0a30cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:19.308429 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4805b5-50be-4f70-b446-470ea0a30cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:19.310061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4805b5-50be-4f70-b446-470ea0a30cc3 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:19.319570 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 550/1098] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:04:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:04:21.703254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e24b8-367d-4df4-87f5-638900d9f795 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:21.703865 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e24b8-367d-4df4-87f5-638900d9f795 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:21.703865 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e24b8-367d-4df4-87f5-638900d9f795 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:21.705244 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 549/1099] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:21.711492 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b945-074c-4756-9059-b0eb48b5c565 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:21.711961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b945-074c-4756-9059-b0eb48b5c565 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:21.712066 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b945-074c-4756-9059-b0eb48b5c565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:21.731922 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-9171b945-074c-4756-9059-b0eb48b5c565 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:21.733115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-9171b945-074c-4756-9059-b0eb48b5c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:21.742555 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 551/1100] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:22.103726 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e24b8-367d-4df4-87f5-638900d9f795 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:22.120216 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e24b8-367d-4df4-87f5-638900d9f795 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:22.124765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35fbc-7e6c-4fea-a939-c05a50923765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:22.125410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35fbc-7e6c-4fea-a939-c05a50923765 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:22.125695 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35fbc-7e6c-4fea-a939-c05a50923765 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:22.125948 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35fbc-7e6c-4fea-a939-c05a50923765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:22.135887 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d35fbc-7e6c-4fea-a939-c05a50923765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:22.137411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d35fbc-7e6c-4fea-a939-c05a50923765 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:22.147449 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 550/1101] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:04:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:04:24.359149 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f838e5d-c5d3-4599-9a6f-48cfcf46a4bf None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:24.359973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f838e5d-c5d3-4599-9a6f-48cfcf46a4bf None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:24.359973 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f838e5d-c5d3-4599-9a6f-48cfcf46a4bf None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:24.362081 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 552/1102] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:24.370559 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d88d5a-d8fc-4c18-96ba-7740836e65c2 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:24.370977 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d88d5a-d8fc-4c18-96ba-7740836e65c2 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:24.371145 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d88d5a-d8fc-4c18-96ba-7740836e65c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:24.400011 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-83d88d5a-d8fc-4c18-96ba-7740836e65c2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:24.401250 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-83d88d5a-d8fc-4c18-96ba-7740836e65c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:24.410227 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 551/1103] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:24.766959 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f838e5d-c5d3-4599-9a6f-48cfcf46a4bf None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:24.779797 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f838e5d-c5d3-4599-9a6f-48cfcf46a4bf None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:24.784264 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f50aa-6c8c-42f1-949e-ab4a470991b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:24.784853 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f50aa-6c8c-42f1-949e-ab4a470991b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:24.785123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f50aa-6c8c-42f1-949e-ab4a470991b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:24.785422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f50aa-6c8c-42f1-949e-ab4a470991b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:24.795072 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f50aa-6c8c-42f1-949e-ab4a470991b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:24.796516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f50aa-6c8c-42f1-949e-ab4a470991b1 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:24.806778 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 553/1104] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:04:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:04:27.084621 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d64511-5018-4155-995c-8ac3c6d3a09e None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:27.085551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d64511-5018-4155-995c-8ac3c6d3a09e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:27.085551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d64511-5018-4155-995c-8ac3c6d3a09e None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:27.087710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 552/1105] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:27.096464 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4ff6-06f0-4a37-9cb1-2f46a8e2731e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:27.097154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4ff6-06f0-4a37-9cb1-2f46a8e2731e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:27.097722 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4ff6-06f0-4a37-9cb1-2f46a8e2731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:27.118977 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-6d9f4ff6-06f0-4a37-9cb1-2f46a8e2731e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:27.120195 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-6d9f4ff6-06f0-4a37-9cb1-2f46a8e2731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:27.129516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 554/1106] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:27.480131 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d64511-5018-4155-995c-8ac3c6d3a09e None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:27.496443 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d64511-5018-4155-995c-8ac3c6d3a09e None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:27.500622 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcaa87-90fd-414f-a02a-f5ef20a2d0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:27.501220 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaa87-90fd-414f-a02a-f5ef20a2d0ae service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:27.501529 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaa87-90fd-414f-a02a-f5ef20a2d0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:27.501802 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaa87-90fd-414f-a02a-f5ef20a2d0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:27.511231 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcaa87-90fd-414f-a02a-f5ef20a2d0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:27.512669 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcaa87-90fd-414f-a02a-f5ef20a2d0ae service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:27.522159 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 553/1107] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:04:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:04:29.880017 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f94c9-2fb5-4ec1-b71a-67749b352644 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:29.880548 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f94c9-2fb5-4ec1-b71a-67749b352644 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:29.880686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f94c9-2fb5-4ec1-b71a-67749b352644 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:29.882723 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 555/1108] 10.222.0.40 () {54 vars in 927 bytes} [Mon Aug 22 14:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:04:29.890538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60f98-5bb1-4826-b66e-e880bcd65cf7 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:29.890934 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60f98-5bb1-4826-b66e-e880bcd65cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:29.891086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60f98-5bb1-4826-b66e-e880bcd65cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:29.912769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-96f60f98-5bb1-4826-b66e-e880bcd65cf7 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:04:29.914110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-96f60f98-5bb1-4826-b66e-e880bcd65cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:04:29.923809 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 554/1109] 10.222.0.40 () {58 vars in 1024 bytes} [Mon Aug 22 14:04:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:04:30.267400 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f94c9-2fb5-4ec1-b71a-67749b352644 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:04:30.282149 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f94c9-2fb5-4ec1-b71a-67749b352644 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:04:30.285979 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aa682-b4ac-492c-bbac-1d23894e534e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:04:30.286602 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa682-b4ac-492c-bbac-1d23894e534e service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:04:30.286876 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa682-b4ac-492c-bbac-1d23894e534e service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:04:30.287143 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa682-b4ac-492c-bbac-1d23894e534e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:04:30.296903 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa682-b4ac-492c-bbac-1d23894e534e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:04:30.298756 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa682-b4ac-492c-bbac-1d23894e534e service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:04:30.308803 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 556/1110] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:04:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:04:39.907548 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=33 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:04:40.304377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=33 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:05:44.243180 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.244171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.244171 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.266155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:05:44.267404 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:44.276088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 555/1111] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:05:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:05:44.284420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.284970 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.284970 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.305699 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:05:44.306897 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:44.315241 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 557/1112] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:05:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:05:44.320105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.330479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866fea-553a-4f9e-8474-cb0eb3221e9e None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.336165 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.336791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.337111 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.337437 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.338150 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:05:44.338490 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.339591 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:44.339591 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:05:44.339591 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:05:44.340734 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.353347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 556/1113] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Aug 22 14:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:05:44.361709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.371422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6253504-f61e-4f9d-892e-ea695c609223 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.377512 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.378117 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.378346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.378656 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.379273 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.381067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:44.381067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:05:44.381067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:05:44.382334 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.415616 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 558/1114] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Aug 22 14:05:44 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:05:44.420164 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.430764 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141be4e7-8281-4162-b2cc-6c296a6d697a admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.490264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.490898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.491179 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.491447 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.492092 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.493158 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:44.493158 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:05:44.493158 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:05:44.494578 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.519873 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 557/1115] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 14:05:44 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:05:44.526549 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.542841 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855177a6-75bd-4164-8bf3-1a98957c90ec admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.548807 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:05:44.552738 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:05:44.553278 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.566100 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 559/1116] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:05:44.570284 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.581088 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522da6ec-02b7-47bc-ae22-765a3276a565 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.586401 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.586998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.587230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.587528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.588160 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.589175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:44.589175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:05:44.589175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:05:44.590083 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481315fa-8672-42dc-b580-cdb8bcd5fd59 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.603461 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 558/1117] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:05:44.608423 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.619445 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8160e-205f-4087-b443-e31a933c7c79 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.625216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.625879 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.626162 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.626425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] PATH_INFO: `/v3/projects/c680b03c6c10447c8320c95037d3aeef/users/4bc61a1e597542ca979548d3f2db8a5e/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.642988 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c680b03c6c10447c8320c95037d3aeef, user_id=4bc61a1e597542ca979548d3f2db8a5e, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.644024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:44.644024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:05:44.644024 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:05:44.646031 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b327-7c71-480c-a624-c63517f5b051 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.661366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 560/1118] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:05:44 2022] PUT /identity/v3/projects/c680b03c6c10447c8320c95037d3aeef/users/4bc61a1e597542ca979548d3f2db8a5e/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:05:44.674226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c5cab-2bcd-465b-a3d5-5c1b32f86f2a None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.674638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c5cab-2bcd-465b-a3d5-5c1b32f86f2a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.674638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c5cab-2bcd-465b-a3d5-5c1b32f86f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.705662 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-763c5cab-2bcd-465b-a3d5-5c1b32f86f2a None None] MFA Rules not processed for user `4bc61a1e597542ca979548d3f2db8a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:05:44.706944 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-763c5cab-2bcd-465b-a3d5-5c1b32f86f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:44.773324 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 559/1119] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:05:44 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:05:44.788365 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ebfb-f4a1-43c2-ab79-a93f61fa1bf6 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.788651 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ebfb-f4a1-43c2-ab79-a93f61fa1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.788895 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ebfb-f4a1-43c2-ab79-a93f61fa1bf6 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.790288 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 561/1120] 10.222.0.40 () {54 vars in 964 bytes} [Mon Aug 22 14:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:05:44.795207 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd0aa2-ed15-4732-986a-01031ecdf434 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.795465 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd0aa2-ed15-4732-986a-01031ecdf434 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.795757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd0aa2-ed15-4732-986a-01031ecdf434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.816459 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-ebfd0aa2-ed15-4732-986a-01031ecdf434 None None] MFA Rules not processed for user `2c40b1bbc4994db9a5c7a40c504a659a`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:05:44.817720 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-ebfd0aa2-ed15-4732-986a-01031ecdf434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:44.863823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:05:44.873847 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 560/1121] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Aug 22 14:05:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:05:44.881420 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621ebfb-f4a1-43c2-ab79-a93f61fa1bf6 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:44.893215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621ebfb-f4a1-43c2-ab79-a93f61fa1bf6 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:44.897175 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c40b1bbc4994db9a5c7a40c504a659a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:44.897795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.898095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.898340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.907105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:44.908649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:44.917719 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 562/1122] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:05:44 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:05:44.957607 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacec20-387b-4830-aa65-713e58ceb02a None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:44.957888 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacec20-387b-4830-aa65-713e58ceb02a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:44.958190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacec20-387b-4830-aa65-713e58ceb02a None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:44.959489 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 561/1123] 10.222.0.40 () {52 vars in 830 bytes} [Mon Aug 22 14:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:05:44.963213 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:45.027021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979fa3e-a9ab-4167-8299-839153d1cdf8 service cinder] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:45.032171 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:45.032871 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:45.033159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:45.033465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] PATH_INFO: `/v3/users/4bc61a1e597542ca979548d3f2db8a5e` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:45.034628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc61a1e597542ca979548d3f2db8a5e)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:45.035635 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:45.035635 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:05:45.035635 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:05:45.036836 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:45.108340 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc61a1e597542ca979548d3f2db8a5e'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.122637 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc61a1e597542ca979548d3f2db8a5e'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.123433 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc61a1e597542ca979548d3f2db8a5e'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.135989 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc61a1e597542ca979548d3f2db8a5e'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.136681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc61a1e597542ca979548d3f2db8a5e'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.166609 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 563/1124] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Aug 22 14:05:44 2022] DELETE /identity/v3/users/4bc61a1e597542ca979548d3f2db8a5e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:05:45.171165 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:45.171448 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:45.171745 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:45.197535 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:05:45.198943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:45.259624 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 562/1125] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:05:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:05:45.270095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:45.271553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:45.277335 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:05:45.330198 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1929-7dcf-4299-826d-846e4a6b2bd2 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:45.334540 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d3ab6-c7fd-4116-915e-a9de5d40e009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:45.335155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d3ab6-c7fd-4116-915e-a9de5d40e009 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:45.335425 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d3ab6-c7fd-4116-915e-a9de5d40e009 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:45.335697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d3ab6-c7fd-4116-915e-a9de5d40e009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:45.345792 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d3ab6-c7fd-4116-915e-a9de5d40e009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:45.347233 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d3ab6-c7fd-4116-915e-a9de5d40e009 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:45.357012 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 564/1126] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:05:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:05:45.735519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:05:45.737430 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:05:45.750420 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2d09-e303-4775-b6f5-d3fa430bc63b None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:05:45.755681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:05:45.756316 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:05:45.756656 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:05:45.756851 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] PATH_INFO: `/v3/projects/c680b03c6c10447c8320c95037d3aeef` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:05:45.758233 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c680b03c6c10447c8320c95037d3aeef)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:05:45.759141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:05:45.759141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:05:45.759141 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:05:45.760405 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:05:45.825052 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c680b03c6c10447c8320c95037d3aeef', 'request_id': 'req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.831015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c680b03c6c10447c8320c95037d3aeef', 'request_id': 'req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.844545 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c680b03c6c10447c8320c95037d3aeef', 'request_id': 'req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.860080 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] The token cache is being invalidate because project c680b03c6c10447c8320c95037d3aeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 14:05:45.860338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.861012 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-7d548ae3-f6e3-42cb-9fc1-4ce6839e807b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:05:45.862660 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 563/1127] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Aug 22 14:05:45 2022] DELETE /identity/v3/projects/c680b03c6c10447c8320c95037d3aeef => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 14:05:55.352687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=25 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:05:55.857214 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:07:13.168225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67879e-3830-416b-ade7-02ccccc789bc None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:13.168852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67879e-3830-416b-ade7-02ccccc789bc None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:13.168852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67879e-3830-416b-ade7-02ccccc789bc None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:13.170164 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:13.176748 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1398-de7e-4e1a-8487-cf3b20d899fc None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:13.177285 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1398-de7e-4e1a-8487-cf3b20d899fc None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:13.177406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1398-de7e-4e1a-8487-cf3b20d899fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:13.259932 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-12fb1398-de7e-4e1a-8487-cf3b20d899fc None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:13.261163 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-12fb1398-de7e-4e1a-8487-cf3b20d899fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:13.367799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:07:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:13.529476 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67879e-3830-416b-ade7-02ccccc789bc None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:13.531888 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-3c67879e-3830-416b-ade7-02ccccc789bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:13.633163 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67879e-3830-416b-ade7-02ccccc789bc None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:13.638775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a9dc9-5e15-4297-8b54-03c8a32c4f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:13.639375 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a9dc9-5e15-4297-8b54-03c8a32c4f3a service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:13.639653 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a9dc9-5e15-4297-8b54-03c8a32c4f3a service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:13.639923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a9dc9-5e15-4297-8b54-03c8a32c4f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:13.648401 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a9dc9-5e15-4297-8b54-03c8a32c4f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:13.650058 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a9dc9-5e15-4297-8b54-03c8a32c4f3a service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:13.659628 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 566/1130] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:14.533938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeffe08-aacb-4c8b-b6e6-3ee98dc04a96 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:14.534552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeffe08-aacb-4c8b-b6e6-3ee98dc04a96 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:14.534552 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeffe08-aacb-4c8b-b6e6-3ee98dc04a96 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:14.535843 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:14.541105 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd5f6-6060-43aa-9c83-b5f48b89146d None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:14.541537 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd5f6-6060-43aa-9c83-b5f48b89146d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:14.541687 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd5f6-6060-43aa-9c83-b5f48b89146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:14.563565 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-2b1fd5f6-6060-43aa-9c83-b5f48b89146d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:14.564779 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-2b1fd5f6-6060-43aa-9c83-b5f48b89146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:14.574315 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:07:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:14.730754 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeffe08-aacb-4c8b-b6e6-3ee98dc04a96 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:14.746343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeffe08-aacb-4c8b-b6e6-3ee98dc04a96 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:14.752001 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89984c90-33fa-44aa-ac3e-5c7d8efcbf25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:14.752743 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89984c90-33fa-44aa-ac3e-5c7d8efcbf25 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:14.753024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89984c90-33fa-44aa-ac3e-5c7d8efcbf25 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:14.753338 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89984c90-33fa-44aa-ac3e-5c7d8efcbf25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:14.761900 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89984c90-33fa-44aa-ac3e-5c7d8efcbf25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:14.763620 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89984c90-33fa-44aa-ac3e-5c7d8efcbf25 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:14.773288 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 566/1133] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:18.599981 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7e10c-b150-498d-aa7d-32948bced89a None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:18.600850 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7e10c-b150-498d-aa7d-32948bced89a None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:18.600850 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7e10c-b150-498d-aa7d-32948bced89a None None] PATH_INFO: `/v3` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:18.602595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 568/1134] 10.222.0.45 () {54 vars in 925 bytes} [Mon Aug 22 14:07:18 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:07:18.614260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20ea80-d1b9-4793-8de3-704eb493e2d5 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:18.614784 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20ea80-d1b9-4793-8de3-704eb493e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:18.614784 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20ea80-d1b9-4793-8de3-704eb493e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:18.647254 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-9f20ea80-d1b9-4793-8de3-704eb493e2d5 None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:18.648560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-9f20ea80-d1b9-4793-8de3-704eb493e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:18.706756 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=100 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:07:18.716995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 567/1135] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Aug 22 14:07:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:07:23.017302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fe65-00c7-4408-8683-4a4c0176b0ed None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:23.017867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fe65-00c7-4408-8683-4a4c0176b0ed None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:23.017867 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fe65-00c7-4408-8683-4a4c0176b0ed None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:23.019170 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 569/1136] 10.222.0.40 () {54 vars in 961 bytes} [Mon Aug 22 14:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:23.025487 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0f9d0-aebc-46fd-8f08-72ec239f8d5f None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:23.026246 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0f9d0-aebc-46fd-8f08-72ec239f8d5f None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:23.026343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0f9d0-aebc-46fd-8f08-72ec239f8d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:23.050867 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a3c0f9d0-aebc-46fd-8f08-72ec239f8d5f None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:23.052107 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a3c0f9d0-aebc-46fd-8f08-72ec239f8d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:23.062377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 568/1137] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Aug 22 14:07:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:23.070767 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fe65-00c7-4408-8683-4a4c0176b0ed None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:23.090316 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fe65-00c7-4408-8683-4a4c0176b0ed None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:23.096104 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae19d5-98ff-4886-91f9-a22a21c318d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:23.096706 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae19d5-98ff-4886-91f9-a22a21c318d8 service placement] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:23.096981 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae19d5-98ff-4886-91f9-a22a21c318d8 service placement] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:23.097285 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae19d5-98ff-4886-91f9-a22a21c318d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:23.105946 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae19d5-98ff-4886-91f9-a22a21c318d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:23.107574 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae19d5-98ff-4886-91f9-a22a21c318d8 service placement] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:23.117737 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 570/1138] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:07:26.035059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af91b-cfd9-4250-aa24-7b641edff80d None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:26.035981 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af91b-cfd9-4250-aa24-7b641edff80d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:26.035981 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af91b-cfd9-4250-aa24-7b641edff80d None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:26.036971 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 14:07:26.042173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a352ad-3a64-4554-9e76-127e835a0755 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:26.042619 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a352ad-3a64-4554-9e76-127e835a0755 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:26.042727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a352ad-3a64-4554-9e76-127e835a0755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:26.062655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-f3a352ad-3a64-4554-9e76-127e835a0755 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:26.063847 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-f3a352ad-3a64-4554-9e76-127e835a0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:26.072048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:07:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:26.234224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af91b-cfd9-4250-aa24-7b641edff80d None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:26.249935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af91b-cfd9-4250-aa24-7b641edff80d None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:26.255016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95af7e-fad3-4c4b-b2f8-c287e20e16e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:26.255636 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95af7e-fad3-4c4b-b2f8-c287e20e16e6 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:26.255914 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95af7e-fad3-4c4b-b2f8-c287e20e16e6 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:26.256184 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95af7e-fad3-4c4b-b2f8-c287e20e16e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:26.266111 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95af7e-fad3-4c4b-b2f8-c287e20e16e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:26.267982 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95af7e-fad3-4c4b-b2f8-c287e20e16e6 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:26.279356 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 570/1141] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:27.111992 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c607b-8397-4015-a622-5a26fff65de7 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:27.112795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c607b-8397-4015-a622-5a26fff65de7 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:27.112795 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c607b-8397-4015-a622-5a26fff65de7 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:27.114339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 14:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:27.119555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e5ef-b2e8-49d5-81c9-af38c023bd6d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:27.119975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e5ef-b2e8-49d5-81c9-af38c023bd6d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:27.120086 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e5ef-b2e8-49d5-81c9-af38c023bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:27.140498 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-11b9e5ef-b2e8-49d5-81c9-af38c023bd6d None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:27.141715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-11b9e5ef-b2e8-49d5-81c9-af38c023bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:27.151015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 14:07:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:27.318483 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c607b-8397-4015-a622-5a26fff65de7 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:27.341231 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c607b-8397-4015-a622-5a26fff65de7 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:27.349852 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98e936-227e-42d0-9ed6-b9c9fcf178c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:27.350450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e936-227e-42d0-9ed6-b9c9fcf178c2 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:27.350727 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e936-227e-42d0-9ed6-b9c9fcf178c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:27.350968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e936-227e-42d0-9ed6-b9c9fcf178c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:27.360378 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98e936-227e-42d0-9ed6-b9c9fcf178c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:27.362119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98e936-227e-42d0-9ed6-b9c9fcf178c2 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:27.380407 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 573/1144] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:31.931561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20a9e-9004-441d-86ac-9283f8ebae98 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:31.932148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20a9e-9004-441d-86ac-9283f8ebae98 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:31.932148 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20a9e-9004-441d-86ac-9283f8ebae98 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:31.933468 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:31.938912 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bf028-9379-472a-b3b5-49317e6867ae None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:31.939408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bf028-9379-472a-b3b5-49317e6867ae None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:31.939408 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bf028-9379-472a-b3b5-49317e6867ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:31.963036 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-477bf028-9379-472a-b3b5-49317e6867ae None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:31.964250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-477bf028-9379-472a-b3b5-49317e6867ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:31.972735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:07:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:32.315591 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20a9e-9004-441d-86ac-9283f8ebae98 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:32.317876 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-51b20a9e-9004-441d-86ac-9283f8ebae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:32.378823 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20a9e-9004-441d-86ac-9283f8ebae98 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:32.382829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1074bc-e347-4039-952a-a471b0190184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:32.383431 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1074bc-e347-4039-952a-a471b0190184 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:32.383705 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1074bc-e347-4039-952a-a471b0190184 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:32.383969 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1074bc-e347-4039-952a-a471b0190184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:32.394183 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1074bc-e347-4039-952a-a471b0190184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:32.395796 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1074bc-e347-4039-952a-a471b0190184 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:32.406161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 573/1147] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:34.591747 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450116-71c4-4a76-855e-d14354cfa6e3 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:34.592676 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450116-71c4-4a76-855e-d14354cfa6e3 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:34.592676 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450116-71c4-4a76-855e-d14354cfa6e3 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:34.594952 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:07:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:34.601837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a855a2-0378-4f3c-940c-6f900b901f00 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:34.602287 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a855a2-0378-4f3c-940c-6f900b901f00 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:34.602394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a855a2-0378-4f3c-940c-6f900b901f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:34.623213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-25a855a2-0378-4f3c-940c-6f900b901f00 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:34.624445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-25a855a2-0378-4f3c-940c-6f900b901f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:34.636700 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:07:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:34.986159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450116-71c4-4a76-855e-d14354cfa6e3 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:34.988292 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-fd450116-71c4-4a76-855e-d14354cfa6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:35.001753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450116-71c4-4a76-855e-d14354cfa6e3 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:35.005746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce72c8-25c6-4786-9561-e2bcc141b92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:35.006348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce72c8-25c6-4786-9561-e2bcc141b92a service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:35.006622 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce72c8-25c6-4786-9561-e2bcc141b92a service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:35.006891 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce72c8-25c6-4786-9561-e2bcc141b92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:35.016391 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce72c8-25c6-4786-9561-e2bcc141b92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:35.017892 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce72c8-25c6-4786-9561-e2bcc141b92a service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:35.029843 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 576/1150] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:38.865462 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16af0-effc-4ed8-b8b7-72c4d8f14f23 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:38.866253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16af0-effc-4ed8-b8b7-72c4d8f14f23 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:38.866253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16af0-effc-4ed8-b8b7-72c4d8f14f23 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:38.867390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:38.874262 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0fa17-447d-4a30-bc95-4cbd244f6bd5 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:38.874936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0fa17-447d-4a30-bc95-4cbd244f6bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:38.874936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0fa17-447d-4a30-bc95-4cbd244f6bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:38.887193 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=67 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:07:38.902419 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-11c0fa17-447d-4a30-bc95-4cbd244f6bd5 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:38.903615 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-11c0fa17-447d-4a30-bc95-4cbd244f6bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:38.912112 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:07:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:07:39.490265 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16af0-effc-4ed8-b8b7-72c4d8f14f23 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:39.495648 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-23d16af0-effc-4ed8-b8b7-72c4d8f14f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:39.561409 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16af0-effc-4ed8-b8b7-72c4d8f14f23 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:39.565344 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be346cc-2d2d-4ca8-b2b8-a0c9749a9cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c40b1bbc4994db9a5c7a40c504a659a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:39.565985 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be346cc-2d2d-4ca8-b2b8-a0c9749a9cfd service cinder] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:39.566335 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be346cc-2d2d-4ca8-b2b8-a0c9749a9cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:39.566612 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be346cc-2d2d-4ca8-b2b8-a0c9749a9cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:39.576025 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be346cc-2d2d-4ca8-b2b8-a0c9749a9cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:39.577539 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be346cc-2d2d-4ca8-b2b8-a0c9749a9cfd service cinder] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:39.587210 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 576/1153] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:41.757585 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e96f7c-68c9-47ee-9a16-38a566da2f9e None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:41.758182 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e96f7c-68c9-47ee-9a16-38a566da2f9e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:41.758182 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e96f7c-68c9-47ee-9a16-38a566da2f9e None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:41.759444 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:07:41.765596 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14890-9854-4c93-b601-3a01d90f2bc9 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:41.766079 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14890-9854-4c93-b601-3a01d90f2bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:41.766203 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14890-9854-4c93-b601-3a01d90f2bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:41.788825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-a0b14890-9854-4c93-b601-3a01d90f2bc9 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:07:41.790225 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a0b14890-9854-4c93-b601-3a01d90f2bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:41.799903 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 14:07:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:07:42.364776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e96f7c-68c9-47ee-9a16-38a566da2f9e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:07:42.367829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-f2e96f7c-68c9-47ee-9a16-38a566da2f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:07:42.386664 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e96f7c-68c9-47ee-9a16-38a566da2f9e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:07:42.390475 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06983df-09bc-4a24-8143-0a37ad19eba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c40b1bbc4994db9a5c7a40c504a659a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:07:42.391079 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06983df-09bc-4a24-8143-0a37ad19eba7 service cinder] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:07:42.391354 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06983df-09bc-4a24-8143-0a37ad19eba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:07:42.391627 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06983df-09bc-4a24-8143-0a37ad19eba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:07:42.401868 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06983df-09bc-4a24-8143-0a37ad19eba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:07:42.402910 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06983df-09bc-4a24-8143-0a37ad19eba7 service cinder] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:07:42.412773 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 579/1156] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:07:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:07:51.782824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=70 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:07:52.408522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=8 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:08:58.501885 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0331bc-79a0-4e71-ba01-ee4964415d44 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.502638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0331bc-79a0-4e71-ba01-ee4964415d44 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.502638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0331bc-79a0-4e71-ba01-ee4964415d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.502835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc977d5-f0ee-4c45-b3da-d54527e67d75 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.502835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc977d5-f0ee-4c45-b3da-d54527e67d75 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.503321 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc977d5-f0ee-4c45-b3da-d54527e67d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.523175 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-bb0331bc-79a0-4e71-ba01-ee4964415d44 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:08:58.524339 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-dfc977d5-f0ee-4c45-b3da-d54527e67d75 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:08:58.530157 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-dfc977d5-f0ee-4c45-b3da-d54527e67d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:08:58.530337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-bb0331bc-79a0-4e71-ba01-ee4964415d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:08:58.537999 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 580/1157] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:08:58.538455 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 578/1158] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:08:58.546880 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170420c-18de-47ac-a13f-256828541df2 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.547071 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.547185 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170420c-18de-47ac-a13f-256828541df2 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.547273 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.547444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.547661 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170420c-18de-47ac-a13f-256828541df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.571237 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:08:58.572452 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:08:58.572723 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-4170420c-18de-47ac-a13f-256828541df2 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:08:58.573977 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-4170420c-18de-47ac-a13f-256828541df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:08:58.581661 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 579/1159] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:08:58.582102 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 581/1160] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:08:58.586377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.589590 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170420c-18de-47ac-a13f-256828541df2 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.596037 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980f75-8b38-4b16-87cb-1da3dd9371d5 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.599038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170420c-18de-47ac-a13f-256828541df2 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.601479 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.602081 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.602353 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.602616 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.603290 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:08:58.603588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.604655 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.605229 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.605346 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.605546 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.605811 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] PATH_INFO: `/v3/domains` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.606474 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 14:08:58.606774 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.608166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:08:58.608166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:08:58.608166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:08:58.608680 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.617808 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 580/1161] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Aug 22 14:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:08:58.620918 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 582/1162] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Aug 22 14:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 14:08:58.628856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.629380 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.639106 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bca2d-219e-4193-8abe-353baf66fcca admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.639258 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04fde1-9e76-4001-99ee-cbc02291f1ed admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.643715 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.643923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.644394 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.644507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.644671 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.644774 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.644941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.645048 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.645593 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.645712 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.646603 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:08:58.646603 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:08:58.646603 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:08:58.647532 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.647774 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.687717 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 581/1163] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:08:58.688704 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 583/1164] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:08:58.692370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.693494 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.755469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade07c3-7d18-4fa7-b2c1-db0384821d57 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.757760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0cb1-1d53-48b6-9708-313c3a7e0511 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.760079 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.760689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.760975 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.761269 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.761891 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.762631 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.763233 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.763510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.763776 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.763875 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.764383 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.765422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:08:58.765422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:08:58.765422 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:08:58.766643 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.787568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 582/1165] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:08:58.789968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 584/1166] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 14:08:58.791594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.793753 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.801938 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4b17-183d-405e-a9e4-959546111068 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.803902 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a5cac-e994-477c-bf7a-3e52eb5cc1d9 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.807122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.807710 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.807986 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.808291 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.808430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.808925 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.809032 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.809302 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.809573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.810197 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.810638 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.811813 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.824396 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 585/1167] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:08:58.824576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 583/1168] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 14:08:58.825563 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.825689 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.835034 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2dc59-efec-4cbe-bf4f-a8285c906053 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.835198 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966decdc-cf3b-40a7-a4fb-365d6f8972a2 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.839684 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.839816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.840263 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.840377 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.840538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.840644 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.840806 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.840910 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.841538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.841653 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.843156 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.843276 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.853429 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 584/1169] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:08:58.857258 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 586/1170] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:08:58.857411 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.858268 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:58.866989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b62aa-7f53-4516-9550-7a490c45473a admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.867877 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2f20-7aa3-4091-8b5a-29dbfa368684 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:58.871629 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.872354 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eca36d-f3aa-4286-bc92-7314d0c075e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:58.872513 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.872741 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.872974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eca36d-f3aa-4286-bc92-7314d0c075e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.873132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] PATH_INFO: `/v3/projects/40867dab8c82497aac55ac06be225af4/users/5f129d6b696d4fd3be4eb7a3124c0dca/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.873363 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eca36d-f3aa-4286-bc92-7314d0c075e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.873638 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eca36d-f3aa-4286-bc92-7314d0c075e0 admin admin] PATH_INFO: `/v3/projects/3375efa028844ac6aa1387456911155d/users/89a3cf7547ad4d549eb83944016eeb3f/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.888838 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eca36d-f3aa-4286-bc92-7314d0c075e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3375efa028844ac6aa1387456911155d, user_id=89a3cf7547ad4d549eb83944016eeb3f, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.889878 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40867dab8c82497aac55ac06be225af4, user_id=5f129d6b696d4fd3be4eb7a3124c0dca, role_id=ee1e3f0c5acb4a5bb3f4cbc3e7df18a4)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:58.890935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:08:58.890935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:08:58.890935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:08:58.891573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eca36d-f3aa-4286-bc92-7314d0c075e0 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.892886 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab5dc0-4feb-430a-bab2-a5e2b6c78704 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:58.906146 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 587/1171] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:08:58 2022] PUT /identity/v3/projects/3375efa028844ac6aa1387456911155d/users/89a3cf7547ad4d549eb83944016eeb3f/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 14:08:58.912334 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 585/1172] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:08:58 2022] PUT /identity/v3/projects/40867dab8c82497aac55ac06be225af4/users/5f129d6b696d4fd3be4eb7a3124c0dca/roles/ee1e3f0c5acb4a5bb3f4cbc3e7df18a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:08:58.914023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.914307 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.914580 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.917557 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:58.917799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:58.918104 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:58.938421 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:08:58.939652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:08:58.943199 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] MFA Rules not processed for user `8875dd4e092c4727887ccb9579eeb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:08:58.944378 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:08:58.983272 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:08:58.987172 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:08:59.003413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 588/1173] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:08:59.006697 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 586/1174] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:08:59.014030 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:59.015858 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:08:59.068710 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f346c-4f75-4771-a5f1-32c13730809e None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:59.069797 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0c2a-0b16-4af7-99ff-6a7db113a253 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:08:59.072397 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc822d3-64d5-49ee-80ae-58331c59ec86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:59.073001 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc822d3-64d5-49ee-80ae-58331c59ec86 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:59.073316 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc822d3-64d5-49ee-80ae-58331c59ec86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:59.073586 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc822d3-64d5-49ee-80ae-58331c59ec86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:59.073693 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e970fd-c824-455a-a344-a0bb21eea8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:08:59.074262 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e970fd-c824-455a-a344-a0bb21eea8ac service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:08:59.074545 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e970fd-c824-455a-a344-a0bb21eea8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:08:59.074818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e970fd-c824-455a-a344-a0bb21eea8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:08:59.082575 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc822d3-64d5-49ee-80ae-58331c59ec86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:59.083989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e970fd-c824-455a-a344-a0bb21eea8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:08:59.084124 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc822d3-64d5-49ee-80ae-58331c59ec86 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:59.085462 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e970fd-c824-455a-a344-a0bb21eea8ac service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:08:59.093801 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 589/1175] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:08:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:08:59.094734 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 587/1176] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:08:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:04.979166 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:04.980885 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:04.981279 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.025651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.026427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.026427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.076617 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] MFA Rules not processed for user `5f129d6b696d4fd3be4eb7a3124c0dca`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:05.079709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:05.100500 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:05.102483 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:05.171248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 590/1177] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:09:04 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:05.175573 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.192147 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb41835-bbf0-454b-800c-f3f7a7030b09 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.198324 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.199077 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.199426 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.199755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] PATH_INFO: `/v3/projects` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.200665 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.202835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.220205 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 588/1178] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:09:05 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:05.224002 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.239486 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3861-15c7-44d1-bc3e-c118621802cb None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.256159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 591/1179] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Aug 22 14:09:05 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:09:05.258182 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.259179 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.259473 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.259816 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] PATH_INFO: `/v3/projects` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.259923 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.260450 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.265758 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.312829 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 589/1180] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Aug 22 14:09:05 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:09:05.315176 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.388247 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:05.395881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cb18e-fb4f-453f-95fe-4a54082e8394 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.429265 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:05.439864 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3260-f62a-4acd-80cc-2ba4c422143a admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.446759 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.448077 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.448970 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.449432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] PATH_INFO: `/v3/users` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.451071 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.459876 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.506168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.506921 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.507351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.507652 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] PATH_INFO: `/v3/users` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.508498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.510747 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.523283 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 590/1181] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 14:09:05 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 14:09:05.527460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.539061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaae88-3d68-4624-9d74-55c76390b96e admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.550155 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.551091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.551314 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.551645 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.552230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.554655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.560250 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 592/1182] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Aug 22 14:09:05 2022] POST /identity/v3/users => generated 298 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 14:09:05.563760 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.571998 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 591/1183] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 14:09:05.573122 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.578389 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07182dd8-fed3-4990-914e-713fbc56f47d admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.583788 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.584517 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.584869 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.585242 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.585975 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.586555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d61d9a-7264-4500-9345-1fa3df41f1eb admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.587816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.592120 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.594667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.594667 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.594879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] PATH_INFO: `/v3/projects/e6e88c215d404594a290f857a00c5439/users/7da2f1a2b8124d659d9d37362dd78f9b/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.607038 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 593/1184] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 14:09:05.611247 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.613337 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e88c215d404594a290f857a00c5439, user_id=7da2f1a2b8124d659d9d37362dd78f9b, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.616098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.622351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7567e-5792-4671-95a6-0fab182bc385 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.628751 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.629387 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.629667 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.629940 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] PATH_INFO: `/v3/projects/b69a17c966e74bd38e738522535178d1/users/88b6705fe749486082251d69a58ea58e/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.632709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 592/1185] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:09:05 2022] PUT /identity/v3/projects/e6e88c215d404594a290f857a00c5439/users/7da2f1a2b8124d659d9d37362dd78f9b/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:09:05.636642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.646498 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69a17c966e74bd38e738522535178d1, user_id=88b6705fe749486082251d69a58ea58e, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.649366 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.666041 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 594/1186] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:09:05 2022] PUT /identity/v3/projects/b69a17c966e74bd38e738522535178d1/users/88b6705fe749486082251d69a58ea58e/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 14:09:05.670065 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.708742 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f0a66-781d-4907-92bd-09225b2e4480 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.744961 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389775a-c9e9-404d-addd-275dc3b19b41 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.750253 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.750881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.751159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.751428 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.752430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.754559 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.769225 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 595/1187] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 14:09:05.770785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.774015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.774714 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.775059 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.775567 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.776584 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.781716 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6575cd-c446-4521-939e-211cc45eda4c admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.782177 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.787405 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d7408-2af9-4ef9-9286-e32c8044108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.788214 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d7408-2af9-4ef9-9286-e32c8044108b admin admin] REQUEST_METHOD: `PUT` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.788553 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d7408-2af9-4ef9-9286-e32c8044108b admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.788890 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d7408-2af9-4ef9-9286-e32c8044108b admin admin] PATH_INFO: `/v3/projects/b69a17c966e74bd38e738522535178d1/users/88b6705fe749486082251d69a58ea58e/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.790920 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d7408-2af9-4ef9-9286-e32c8044108b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69a17c966e74bd38e738522535178d1, user_id=88b6705fe749486082251d69a58ea58e, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.793903 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 593/1188] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Aug 22 14:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 14:09:05.794331 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d7408-2af9-4ef9-9286-e32c8044108b admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.798443 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:05.806545 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 596/1189] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:09:05 2022] PUT /identity/v3/projects/b69a17c966e74bd38e738522535178d1/users/88b6705fe749486082251d69a58ea58e/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 14:09:05.811839 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645690-31b3-4b6d-b74f-d59b2bb2bf94 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:05.873831 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:05.883324 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:05.884755 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] REQUEST_METHOD: `PUT` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:05.885301 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:05.885865 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] PATH_INFO: `/v3/projects/e6e88c215d404594a290f857a00c5439/users/7da2f1a2b8124d659d9d37362dd78f9b/roles/464333398f24462987d7dbfb8e31ccd9` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:05.888719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e88c215d404594a290f857a00c5439, user_id=7da2f1a2b8124d659d9d37362dd78f9b, role_id=464333398f24462987d7dbfb8e31ccd9)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:05.891789 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:05.904094 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 594/1190] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Aug 22 14:09:05 2022] PUT /identity/v3/projects/e6e88c215d404594a290f857a00c5439/users/7da2f1a2b8124d659d9d37362dd78f9b/roles/464333398f24462987d7dbfb8e31ccd9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 14:09:12.199779 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492e05-45ff-4e5d-b633-80549426baab None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:12.200369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492e05-45ff-4e5d-b633-80549426baab None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:12.200369 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492e05-45ff-4e5d-b633-80549426baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:12.255026 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-58492e05-45ff-4e5d-b633-80549426baab None None] MFA Rules not processed for user `88b6705fe749486082251d69a58ea58e`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:12.256641 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-58492e05-45ff-4e5d-b633-80549426baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:12.306596 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:12.374977 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 597/1191] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:09:12 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:12.394384 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:12.396683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:12.527528 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e3d84-3dd2-4337-8dc6-641b2ba66921 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:12.533876 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0911dbafa3421baea46c2cf923a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:12.534610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:12.535179 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:12.535333 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:12.638211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:12.639870 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:12.657487 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 595/1192] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:12 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:12.803533 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117e5c-9696-4e26-91ff-be9834dc2fab None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:12.804025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117e5c-9696-4e26-91ff-be9834dc2fab None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:12.804025 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117e5c-9696-4e26-91ff-be9834dc2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:12.843896 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-9a117e5c-9696-4e26-91ff-be9834dc2fab None None] MFA Rules not processed for user `7da2f1a2b8124d659d9d37362dd78f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:12.845327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-9a117e5c-9696-4e26-91ff-be9834dc2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:12.952175 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 598/1193] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:09:12 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:12.968427 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:12.983389 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75f33-23a4-43a5-a0fe-7d05f5a64bf2 service glance] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:12.987538 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860322-6ecb-402f-b518-d2825c9b8d74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0911dbafa3421baea46c2cf923a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:12.988173 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860322-6ecb-402f-b518-d2825c9b8d74 service glance] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:12.988445 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860322-6ecb-402f-b518-d2825c9b8d74 service glance] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:12.988722 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860322-6ecb-402f-b518-d2825c9b8d74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:13.079460 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860322-6ecb-402f-b518-d2825c9b8d74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:13.092508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860322-6ecb-402f-b518-d2825c9b8d74 service glance] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:13.113524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 596/1194] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:12 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:20.904873 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8836-26fd-4fcb-a08e-5e6e2536d878 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:20.905461 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8836-26fd-4fcb-a08e-5e6e2536d878 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:20.905461 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8836-26fd-4fcb-a08e-5e6e2536d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:20.930083 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-17ba8836-26fd-4fcb-a08e-5e6e2536d878 None None] MFA Rules not processed for user `5f129d6b696d4fd3be4eb7a3124c0dca`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:20.931305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-17ba8836-26fd-4fcb-a08e-5e6e2536d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:20.939343 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 599/1195] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:09:20 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:21.263091 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffde3cc-b905-4874-b123-4480902df6fa None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.264308 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffde3cc-b905-4874-b123-4480902df6fa None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.264893 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffde3cc-b905-4874-b123-4480902df6fa None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.266862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 597/1196] 10.222.0.40 () {54 vars in 962 bytes} [Mon Aug 22 14:09:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:21.273625 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.273846 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.274027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.310173 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:21.311417 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:21.385895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446670-1a39-43e2-a1f9-35d025eda482 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.386995 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446670-1a39-43e2-a1f9-35d025eda482 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.387357 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446670-1a39-43e2-a1f9-35d025eda482 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.388894 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 598/1197] 10.222.0.40 () {54 vars in 912 bytes} [Mon Aug 22 14:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:21.389021 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 600/1198] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Aug 22 14:09:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:09:21.394818 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242d62-79a2-44dc-acf4-8311862a48ed None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.395239 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242d62-79a2-44dc-acf4-8311862a48ed None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.395615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242d62-79a2-44dc-acf4-8311862a48ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.420370 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-cf242d62-79a2-44dc-acf4-8311862a48ed None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:21.421753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-cf242d62-79a2-44dc-acf4-8311862a48ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:21.431190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 599/1199] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Aug 22 14:09:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:21.443382 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:21.444971 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:21.458564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88b00-15d3-47b4-a01e-a4a1600203ce None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:21.463147 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104cd5-11c9-4f50-9af0-7e59059202cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0911dbafa3421baea46c2cf923a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:21.463804 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104cd5-11c9-4f50-9af0-7e59059202cc service glance] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.464094 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104cd5-11c9-4f50-9af0-7e59059202cc service glance] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.464465 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104cd5-11c9-4f50-9af0-7e59059202cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.474781 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104cd5-11c9-4f50-9af0-7e59059202cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:21.476248 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104cd5-11c9-4f50-9af0-7e59059202cc service glance] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:21.489601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 601/1200] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:21.879138 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c8c9-8af4-4a25-af7a-dbde72851f84 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.885642 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c8c9-8af4-4a25-af7a-dbde72851f84 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.885929 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c8c9-8af4-4a25-af7a-dbde72851f84 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.887738 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 600/1201] 10.222.0.40 () {54 vars in 912 bytes} [Mon Aug 22 14:09:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:21.901126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450d741-7f69-457f-b2ca-c4ab8f6a2010 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:21.901126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450d741-7f69-457f-b2ca-c4ab8f6a2010 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:21.901126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450d741-7f69-457f-b2ca-c4ab8f6a2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:21.929508 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=100 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:21.934934 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-d450d741-7f69-457f-b2ca-c4ab8f6a2010 None None] MFA Rules not processed for user `2800cc436ad94811b4e938ee81124b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:21.936896 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-d450d741-7f69-457f-b2ca-c4ab8f6a2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:22.002679 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 602/1202] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Aug 22 14:09:21 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:22.014422 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c8c9-8af4-4a25-af7a-dbde72851f84 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:22.026372 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c8c9-8af4-4a25-af7a-dbde72851f84 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:22.030003 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49b6c-7d79-447c-9ff3-68f98b24c0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:22.030631 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49b6c-7d79-447c-9ff3-68f98b24c0da service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.030895 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49b6c-7d79-447c-9ff3-68f98b24c0da service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.031161 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49b6c-7d79-447c-9ff3-68f98b24c0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.039719 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49b6c-7d79-447c-9ff3-68f98b24c0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:22.041170 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49b6c-7d79-447c-9ff3-68f98b24c0da service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:22.050560 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 601/1203] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:22 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:09:22.603095 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5247268-2eee-4ce2-acf9-9b87546081f1 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.603375 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5247268-2eee-4ce2-acf9-9b87546081f1 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.603649 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5247268-2eee-4ce2-acf9-9b87546081f1 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.605309 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 603/1204] 10.222.0.40 () {54 vars in 962 bytes} [Mon Aug 22 14:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:22.611379 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520877ec-2f3f-46a3-a637-0af2763899ab None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.611920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520877ec-2f3f-46a3-a637-0af2763899ab None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.612024 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520877ec-2f3f-46a3-a637-0af2763899ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.635142 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-520877ec-2f3f-46a3-a637-0af2763899ab None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:22.636353 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-520877ec-2f3f-46a3-a637-0af2763899ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:22.640418 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0baf-00ab-467f-8856-d5eda872fd22 None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.640840 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0baf-00ab-467f-8856-d5eda872fd22 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.641118 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0baf-00ab-467f-8856-d5eda872fd22 None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.642550 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 604/1205] 10.222.0.40 () {54 vars in 961 bytes} [Mon Aug 22 14:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:22.647451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839d3d-30fb-466d-b482-904037295d5b None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.647736 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839d3d-30fb-466d-b482-904037295d5b None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.648011 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839d3d-30fb-466d-b482-904037295d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.648602 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 602/1206] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Aug 22 14:09:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:09:22.653994 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b88bef-214f-40fc-a225-09cd8f22aaa9 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.654281 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b88bef-214f-40fc-a225-09cd8f22aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.654566 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b88bef-214f-40fc-a225-09cd8f22aaa9 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.655943 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 603/1207] 10.222.0.40 () {54 vars in 912 bytes} [Mon Aug 22 14:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 14:09:22.660582 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.660825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.661102 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.670714 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:22.675833 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-47839d3d-30fb-466d-b482-904037295d5b None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:22.677228 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-47839d3d-30fb-466d-b482-904037295d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:22.683015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:22.684195 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:22.693566 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 604/1208] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Aug 22 14:09:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:22.705805 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:22.715757 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096018e-483e-43af-a01f-a0a418b3640d None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:22.719569 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:22.720185 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.720463 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.720749 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.730941 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:22.732377 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:22.743061 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 605/1209] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:09:22.749042 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 605/1210] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Aug 22 14:09:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:09:22.758258 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:22.771098 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc109ef5-4df9-4d22-8cd9-d2f65c1b4f12 service neutron] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:22.777406 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:22.778384 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:22.778671 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:22.778948 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:22.780769 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:22.795668 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:22.797797 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:22.808680 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 606/1211] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:32.530165 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8d2d-08f9-4f96-b26e-21c6c69d2e90 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:32.530755 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8d2d-08f9-4f96-b26e-21c6c69d2e90 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:32.531119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8d2d-08f9-4f96-b26e-21c6c69d2e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:32.552161 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-517c8d2d-08f9-4f96-b26e-21c6c69d2e90 None None] MFA Rules not processed for user `2800cc436ad94811b4e938ee81124b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:32.553451 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-517c8d2d-08f9-4f96-b26e-21c6c69d2e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:32.560531 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 606/1212] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Aug 22 14:09:32 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:32.574874 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:32.584234 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117051d-bbc6-4335-9423-e127830fe727 service placement] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:32.587914 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd202f-120e-4435-b10c-f502fc4399d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:32.588509 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd202f-120e-4435-b10c-f502fc4399d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:32.588782 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd202f-120e-4435-b10c-f502fc4399d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:32.589079 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd202f-120e-4435-b10c-f502fc4399d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:32.596253 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd202f-120e-4435-b10c-f502fc4399d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:32.597743 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd202f-120e-4435-b10c-f502fc4399d6 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:32.605399 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 607/1213] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:33.416168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fede04-dee0-4484-9d6d-cfeb06c228db None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:33.416816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fede04-dee0-4484-9d6d-cfeb06c228db None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:33.417212 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fede04-dee0-4484-9d6d-cfeb06c228db None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:33.419592 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 607/1214] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:33.468817 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e27a-55e2-4c5a-9ed3-fc214862523b None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:33.469323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e27a-55e2-4c5a-9ed3-fc214862523b None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:33.469675 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e27a-55e2-4c5a-9ed3-fc214862523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:33.489138 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-4fd4e27a-55e2-4c5a-9ed3-fc214862523b None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:33.490521 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-4fd4e27a-55e2-4c5a-9ed3-fc214862523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:33.501615 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 608/1215] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:09:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:33.543889 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fede04-dee0-4484-9d6d-cfeb06c228db None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:33.564337 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fede04-dee0-4484-9d6d-cfeb06c228db None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:33.571733 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf900aad-7c55-424a-9b78-5c1f48b3ddab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:33.572595 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900aad-7c55-424a-9b78-5c1f48b3ddab service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:33.573301 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900aad-7c55-424a-9b78-5c1f48b3ddab service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:33.573816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900aad-7c55-424a-9b78-5c1f48b3ddab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:33.587701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf900aad-7c55-424a-9b78-5c1f48b3ddab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:33.589577 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf900aad-7c55-424a-9b78-5c1f48b3ddab service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:33.600603 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 608/1216] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:38.852562 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a77c-6899-4917-b99a-41cfd0201c05 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:38.853482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a77c-6899-4917-b99a-41cfd0201c05 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:38.853482 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a77c-6899-4917-b99a-41cfd0201c05 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:38.854701 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 609/1217] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 14:09:38.865380 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:38.865956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:38.865956 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:38.889544 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:38.890864 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:38.900695 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 609/1218] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:09:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:38.927604 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a77c-6899-4917-b99a-41cfd0201c05 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:38.946224 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a77c-6899-4917-b99a-41cfd0201c05 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:38.952055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648eb18-2126-48c5-971d-f2aea58d1727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:38.952703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648eb18-2126-48c5-971d-f2aea58d1727 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:38.953075 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648eb18-2126-48c5-971d-f2aea58d1727 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:38.953419 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648eb18-2126-48c5-971d-f2aea58d1727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:38.964178 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648eb18-2126-48c5-971d-f2aea58d1727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:38.965983 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648eb18-2126-48c5-971d-f2aea58d1727 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:38.976718 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 610/1219] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:48.884845 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=61 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:48.972576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=28 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:09:50.640735 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:50.650413 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe47d-94f2-4962-a562-0cccd83c48f9 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:50.654086 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a521-6094-4df5-bc59-24b9808d9dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:50.654746 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a521-6094-4df5-bc59-24b9808d9dea service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:50.655056 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a521-6094-4df5-bc59-24b9808d9dea service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:50.655325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a521-6094-4df5-bc59-24b9808d9dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:50.664222 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a521-6094-4df5-bc59-24b9808d9dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:50.665681 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a521-6094-4df5-bc59-24b9808d9dea service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:50.675632 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 610/1220] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:50 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:09:52.672402 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb95b-c483-469d-9e48-d5fd5ed5ba11 None None] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:52.673016 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb95b-c483-469d-9e48-d5fd5ed5ba11 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:52.673117 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb95b-c483-469d-9e48-d5fd5ed5ba11 None None] PATH_INFO: `/` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:52.674627 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 611/1221] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:09:52.681771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57b97b-5f8f-4e69-9772-556a235b3365 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:52.682601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57b97b-5f8f-4e69-9772-556a235b3365 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:52.682601 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57b97b-5f8f-4e69-9772-556a235b3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:52.709668 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-0a57b97b-5f8f-4e69-9772-556a235b3365 None None] MFA Rules not processed for user `0d23523367ac4aaf8768b750ad23e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:09:52.714455 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0a57b97b-5f8f-4e69-9772-556a235b3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:09:52.724266 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 611/1222] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:09:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:09:52.741108 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eb95b-c483-469d-9e48-d5fd5ed5ba11 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:09:52.759908 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eb95b-c483-469d-9e48-d5fd5ed5ba11 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:09:52.766933 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995bb06-9f9f-4109-b5e2-122fa8eda3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:09:52.768015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bb06-9f9f-4109-b5e2-122fa8eda3e6 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:09:52.768704 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bb06-9f9f-4109-b5e2-122fa8eda3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:09:52.769387 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bb06-9f9f-4109-b5e2-122fa8eda3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:09:52.785965 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995bb06-9f9f-4109-b5e2-122fa8eda3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:09:52.787856 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995bb06-9f9f-4109-b5e2-122fa8eda3e6 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:09:52.811469 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 612/1223] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:09:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:10:02.703257 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=9 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:10:02.795837 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=6 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:10:12.644280 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:10:12.644851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:10:12.644851 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:10:12.664749 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:10:12.665974 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:10:12.673764 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 612/1224] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:10:12 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:10:13.000403 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a113-32d7-4e42-8bc1-166ddca10fe7 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:10:13.000957 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a113-32d7-4e42-8bc1-166ddca10fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:10:13.000957 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a113-32d7-4e42-8bc1-166ddca10fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:10:13.027005 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-54a9a113-32d7-4e42-8bc1-166ddca10fe7 None None] MFA Rules not processed for user `2800cc436ad94811b4e938ee81124b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:10:13.028318 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-54a9a113-32d7-4e42-8bc1-166ddca10fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:10:13.034980 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 613/1225] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Aug 22 14:10:12 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:10:13.046787 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:10:13.057146 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6eaf-5dd6-4e6d-bd14-97435965739d None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:10:13.062027 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc5157-5cb9-40ea-8932-26c6217c0806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:10:13.062798 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc5157-5cb9-40ea-8932-26c6217c0806 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:10:13.063071 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc5157-5cb9-40ea-8932-26c6217c0806 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:10:13.063469 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc5157-5cb9-40ea-8932-26c6217c0806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:10:13.071865 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc5157-5cb9-40ea-8932-26c6217c0806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:10:13.073061 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc5157-5cb9-40ea-8932-26c6217c0806 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:10:13.081376 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 613/1226] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:10:13 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:10:23.022260 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:10:23.078089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=9 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:10:38.191410 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53874-4c8d-4612-93c2-c32733bee12e None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:10:38.191923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53874-4c8d-4612-93c2-c32733bee12e None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:10:38.191923 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53874-4c8d-4612-93c2-c32733bee12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:10:38.212681 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-46e53874-4c8d-4612-93c2-c32733bee12e None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:10:38.213939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-46e53874-4c8d-4612-93c2-c32733bee12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:10:38.222093 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 614/1227] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:10:38 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:10:48.206921 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:10:51.892238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:10:51.892750 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:10:51.892750 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:10:51.920082 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:10:51.921968 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:10:51.930969 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 614/1228] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:10:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:11:01.912033 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:11:50.185444 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:11:50.186262 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:11:50.186262 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:11:50.206332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:11:50.207588 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:11:50.215451 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 615/1229] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:11:50 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:12:00.200655 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=3 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:12:02.479927 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:12:02.500825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4fd31-2425-470a-85dd-d19123482b67 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:12:02.504834 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d52998-b49c-4dfc-8550-1c1578f28e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:12:02.505548 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52998-b49c-4dfc-8550-1c1578f28e64 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:12:02.505825 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52998-b49c-4dfc-8550-1c1578f28e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:12:02.506115 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52998-b49c-4dfc-8550-1c1578f28e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:12:02.516055 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d52998-b49c-4dfc-8550-1c1578f28e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:12:02.517703 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d52998-b49c-4dfc-8550-1c1578f28e64 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:12:02.530246 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 615/1230] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:12:02 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:12:12.524566 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=10 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:13:20.847368 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:13:20.875268 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2b395-d36b-440f-b1ad-8e7488d39021 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:13:20.882192 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:13:20.882846 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:13:20.883152 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:13:20.883440 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:13:20.894898 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:13:20.896768 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:13:20.908561 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 616/1231] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:13:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:13:30.903053 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=10 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:13:49.038948 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393d99-1866-4060-b475-1e736818f014 None None] REQUEST_METHOD: `POST` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:13:49.039530 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393d99-1866-4060-b475-1e736818f014 None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:13:49.039530 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393d99-1866-4060-b475-1e736818f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:13:49.061765 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.auth.core [None req-75393d99-1866-4060-b475-1e736818f014 None None] MFA Rules not processed for user `5f129d6b696d4fd3be4eb7a3124c0dca`. Rule list: `[]` (Enabled: `True`). {{(pid=88414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:13:49.063023 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-75393d99-1866-4060-b475-1e736818f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:13:49.071939 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 616/1232] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:13:49 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:13:59.056220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=3 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:14:12.150734 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:14:12.217939 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60fcf-3d53-48d6-a7ed-8cc1fd21228e service placement] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:14:12.222696 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45123-0b50-4b29-b8ec-7815b45150fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c40b1bbc4994db9a5c7a40c504a659a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:14:12.223300 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45123-0b50-4b29-b8ec-7815b45150fe service cinder] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:14:12.223594 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45123-0b50-4b29-b8ec-7815b45150fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:14:12.223866 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45123-0b50-4b29-b8ec-7815b45150fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:14:12.234526 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd45123-0b50-4b29-b8ec-7815b45150fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:14:12.236104 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd45123-0b50-4b29-b8ec-7815b45150fe service cinder] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:14:12.246226 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 617/1233] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:14:12 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:14:13.492005 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75393d99-1866-4060-b475-1e736818f014 None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:14:13.502829 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75393d99-1866-4060-b475-1e736818f014 None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:14:13.506418 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:14:13.507037 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:14:13.507310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:14:13.507576 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:14:13.516686 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:14:13.518236 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:14:13.528227 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 617/1234] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:14:13 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:14:16.686303 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:14:16.686303 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:14:16.686783 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:14:16.707306 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:14:16.708555 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:14:16.715848 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 618/1235] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:14:16 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:14:22.146540 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:14:22.156177 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2a8f-c318-45a4-8dfb-a270b9da5ab2 service neutron] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:14:22.160775 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:14:22.161430 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:14:22.161713 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:14:22.162353 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:14:22.173222 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:14:22.174693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:14:22.195645 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 618/1236] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:14:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:14:23.387729 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:14:23.399517 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f0a73-dd2e-48c8-8f27-1ba7d488f5ba None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:14:23.404323 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:14:23.405027 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:14:23.405302 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:14:23.405580 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:14:23.417344 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:14:23.419105 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:14:23.436803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 619/1237] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:14:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:14:32.192748 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=16 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:14:33.429347 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=39 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:14:42.262453 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:14:42.271507 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b669e5-70cd-4b35-a39d-211202ab3278 service neutron] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:14:42.276547 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:14:42.277154 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:14:42.277448 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:14:42.277697 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:14:42.285089 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:14:42.286951 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:14:42.294985 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 619/1238] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:14:42 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 14:14:52.291582 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=6 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:15:28.947949 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:28.981008 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ab55-93f6-4224-8d36-4b3b0d0dcf75 service neutron] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:28.992489 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:28.994087 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:28.996100 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:28.997332 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:29.026604 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:29.028709 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:29.041768 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 620/1239] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:15:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:15:35.563220 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:35.576028 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1825c2-013c-4bff-8a7e-447d9c48c3c3 service neutron] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:35.581126 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611ed7a-7a24-428c-9ad3-959d208ae6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:35.581791 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611ed7a-7a24-428c-9ad3-959d208ae6c3 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:35.582067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611ed7a-7a24-428c-9ad3-959d208ae6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:35.582338 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611ed7a-7a24-428c-9ad3-959d208ae6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:35.593317 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611ed7a-7a24-428c-9ad3-959d208ae6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:35.595006 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611ed7a-7a24-428c-9ad3-959d208ae6c3 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:35.607321 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 620/1240] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:15:35 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:15:36.953958 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:36.964065 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f551a-1f49-4cbd-bca6-7d847c129906 service nova] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:36.968581 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1c891-9b8f-4188-a23b-6ab3fab7a191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:36.969204 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c891-9b8f-4188-a23b-6ab3fab7a191 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:36.969508 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c891-9b8f-4188-a23b-6ab3fab7a191 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:36.969905 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c891-9b8f-4188-a23b-6ab3fab7a191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:37.037360 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1c891-9b8f-4188-a23b-6ab3fab7a191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:37.038824 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1c891-9b8f-4188-a23b-6ab3fab7a191 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:37.058230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 621/1241] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:15:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:15:40.466717 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aade8-4f26-4f2f-aa42-87397fa491bf None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:40.468208 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aade8-4f26-4f2f-aa42-87397fa491bf None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:40.468489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aade8-4f26-4f2f-aa42-87397fa491bf None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:40.470701 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 621/1242] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:15:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:15:40.480213 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:40.480733 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:40.480862 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:40.562574 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:15:40.563814 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:15:40.578110 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 622/1243] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:15:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:15:40.596460 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aade8-4f26-4f2f-aa42-87397fa491bf None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:40.613450 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aade8-4f26-4f2f-aa42-87397fa491bf None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:40.621271 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:40.622444 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:40.622907 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:40.623342 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:40.633533 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:40.635135 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:40.648510 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 622/1244] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:15:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:15:43.757485 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:43.771453 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081747-aa2a-4e58-abe7-10983051b622 None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:43.776915 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:43.777610 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:43.777894 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:43.778211 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] PATH_INFO: `/v3/users/5f129d6b696d4fd3be4eb7a3124c0dca` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:43.779497 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f129d6b696d4fd3be4eb7a3124c0dca)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:43.780573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: WARNING py.warnings [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:15:43.780573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: warnings.warn(msg) Aug 22 14:15:43.780573 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: Aug 22 14:15:43.781860 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:43.849146 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f129d6b696d4fd3be4eb7a3124c0dca'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:43.858215 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f129d6b696d4fd3be4eb7a3124c0dca'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:43.858914 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f129d6b696d4fd3be4eb7a3124c0dca'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:43.859551 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f129d6b696d4fd3be4eb7a3124c0dca'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:43.872343 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f129d6b696d4fd3be4eb7a3124c0dca'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:43.897753 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 623/1245] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Aug 22 14:15:43 2022] DELETE /identity/v3/users/5f129d6b696d4fd3be4eb7a3124c0dca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:15:44.090191 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:44.106542 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5f651-0f9a-4130-a908-d549970c671a service placement] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:44.171278 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:44.171936 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:44.172215 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:44.172485 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] PATH_INFO: `/v3/projects/40867dab8c82497aac55ac06be225af4` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:44.173683 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40867dab8c82497aac55ac06be225af4)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:44.174739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: WARNING py.warnings [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 14:15:44.174739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: warnings.warn(msg) Aug 22 14:15:44.174739 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: Aug 22 14:15:44.175937 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:44.238545 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40867dab8c82497aac55ac06be225af4', 'request_id': 'req-8de0619a-5c99-493b-bc78-5ed98d91e831'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.244757 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40867dab8c82497aac55ac06be225af4', 'request_id': 'req-8de0619a-5c99-493b-bc78-5ed98d91e831'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.262019 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40867dab8c82497aac55ac06be225af4', 'request_id': 'req-8de0619a-5c99-493b-bc78-5ed98d91e831'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.277610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] The token cache is being invalidate because project 40867dab8c82497aac55ac06be225af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 14:15:44.277901 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.278636 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.280224 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 623/1246] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Aug 22 14:15:44 2022] DELETE /identity/v3/projects/40867dab8c82497aac55ac06be225af4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:15:44.284432 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:44.286311 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:15:44.295849 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:15:44.299825 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663f528-857f-4259-b7c3-4217dda07d05 admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:44.368015 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:44.368576 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:44.368857 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:44.369132 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] PATH_INFO: `/v3/users/88b6705fe749486082251d69a58ea58e` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:44.370319 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b6705fe749486082251d69a58ea58e)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:44.372408 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:44.419722 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b6705fe749486082251d69a58ea58e'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.428524 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b6705fe749486082251d69a58ea58e'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.429230 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b6705fe749486082251d69a58ea58e'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.430072 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b6705fe749486082251d69a58ea58e'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.438678 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-bc004f5d-70f7-4ed4-86df-219d4101891e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b6705fe749486082251d69a58ea58e'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.456295 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 624/1247] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Aug 22 14:15:44 2022] DELETE /identity/v3/users/88b6705fe749486082251d69a58ea58e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:15:44.656187 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:15:44.657771 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:15:44.674816 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0619a-5c99-493b-bc78-5ed98d91e831 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:15:44.736489 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:15:44.737119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:15:44.737432 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:15:44.737700 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] PATH_INFO: `/v3/projects/b69a17c966e74bd38e738522535178d1` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:15:44.738828 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69a17c966e74bd38e738522535178d1)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:15:44.740737 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:15:44.747351 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:15:44.794142 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69a17c966e74bd38e738522535178d1', 'request_id': 'req-24ace27b-5e39-4838-9fbc-5573e3615937'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.800374 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69a17c966e74bd38e738522535178d1', 'request_id': 'req-24ace27b-5e39-4838-9fbc-5573e3615937'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.807704 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69a17c966e74bd38e738522535178d1', 'request_id': 'req-24ace27b-5e39-4838-9fbc-5573e3615937'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.822883 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] The token cache is being invalidate because project b69a17c966e74bd38e738522535178d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 14:15:44.823168 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.823789 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:15:44.825399 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 624/1248] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Aug 22 14:15:44 2022] DELETE /identity/v3/projects/b69a17c966e74bd38e738522535178d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:15:54.452789 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:15:54.819835 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:16:13.563644 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:16:13.564116 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:16:13.564212 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:16:13.592803 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] MFA Rules not processed for user `89a3cf7547ad4d549eb83944016eeb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:16:13.594055 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:13.662325 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 625/1249] 10.222.0.40 () {58 vars in 958 bytes} [Mon Aug 22 14:16:13 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 14:16:14.000766 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:16:14.002487 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:14.064626 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ace27b-5e39-4838-9fbc-5573e3615937 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:16:14.069216 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:16:14.069983 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:16:14.070274 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:16:14.070571 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:16:14.072462 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:14.082564 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:16:14.084109 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:16:14.091960 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 625/1250] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:16:13 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:16:14.579692 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:16:14.581519 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:14.656631 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9689-31cd-43dc-8fcb-d03cad28c2ea None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:16:14.662097 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:16:14.662716 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:16:14.662993 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:16:14.663264 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:16:14.664989 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:14.677258 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:16:14.678915 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:16:14.693351 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 626/1251] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:16:14 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:16:24.088534 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=26 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:16:24.687935 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=57 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:16:24.778160 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:16:24.779819 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:24.861321 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf55d-93c9-47ea-8f11-eb0f88142186 service neutron] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:16:24.866200 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:16:24.866808 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:16:24.867084 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:16:24.867355 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:16:24.869067 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:16:24.881226 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:16:24.882850 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:16:24.894327 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 626/1252] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:16:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:16:34.888881 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=32 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:18:26.814190 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:18:26.857826 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b9bf-a507-4181-b039-52a356331801 service placement] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:18:26.863794 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:18:26.864390 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:18:26.864664 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:18:26.864930 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:18:26.866730 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:18:26.897169 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:18:26.898765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:18:26.908859 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 627/1253] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:18:26 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:18:36.904505 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=28 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:19:14.044854 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:14.046665 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:14.116305 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad35912-7c7e-453b-b818-b68e7f276f6a service nova] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:14.123395 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d23523367ac4aaf8768b750ad23e02b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:14.124155 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:14.124454 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:14.124709 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:14.126728 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:14.167310 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:14.168875 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022c5c-0be2-4d15-a142-1788cd289450 service nova] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:14.188238 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 627/1254] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:19:14 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:19:16.147683 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:16.159491 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11265da6-4f84-4182-8708-34b5b0744ce6 service placement] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:16.163568 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2800cc436ad94811b4e938ee81124b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:16.164228 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:16.164512 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:16.164785 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:16.166630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:16.256046 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:16.257550 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449806c1-7f2a-4a01-8f3b-3d64efe34784 service neutron] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:16.267312 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 628/1255] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:19:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:19:19.616556 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefdead-4ac7-40e0-96b9-dca6aff834fd None None] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:19.617123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefdead-4ac7-40e0-96b9-dca6aff834fd None None] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:19.617123 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefdead-4ac7-40e0-96b9-dca6aff834fd None None] PATH_INFO: `/` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:19.618593 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 628/1256] 10.222.0.40 () {54 vars in 921 bytes} [Mon Aug 22 14:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 14:19:19.624023 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] REQUEST_METHOD: `POST` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:19.624791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:19.624791 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:19.654763 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.auth.core [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] MFA Rules not processed for user `3f3cda72513b4690a3b51e81d50a0344`. Rule list: `[]` (Enabled: `True`). {{(pid=88413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 14:19:19.656358 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:19.667297 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 629/1257] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Aug 22 14:19:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 14:19:19.681329 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefdead-4ac7-40e0-96b9-dca6aff834fd None None] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:19.685785 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-bbefdead-4ac7-40e0-96b9-dca6aff834fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:19.713516 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefdead-4ac7-40e0-96b9-dca6aff834fd None None] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:19.718978 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:19.719610 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] REQUEST_METHOD: `GET` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:19.719879 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:19.720151 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:19.729285 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:19.730879 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:19.741094 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 629/1258] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:19:19 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:19:23.144611 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:23.146799 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:23.162920 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b4727-d9ba-4f2f-912c-a0695b88bf7a None None] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:23.168646 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:23.169326 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:23.169608 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:23.169889 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] PATH_INFO: `/v3/users/89a3cf7547ad4d549eb83944016eeb3f` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:23.172626 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a3cf7547ad4d549eb83944016eeb3f)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:23.173146 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:23.229658 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a3cf7547ad4d549eb83944016eeb3f'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.240020 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a3cf7547ad4d549eb83944016eeb3f'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.240654 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a3cf7547ad4d549eb83944016eeb3f'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.241380 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a3cf7547ad4d549eb83944016eeb3f'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.249146 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a3cf7547ad4d549eb83944016eeb3f'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.268303 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 630/1259] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Aug 22 14:19:23 2022] DELETE /identity/v3/users/89a3cf7547ad4d549eb83944016eeb3f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:19:23.455016 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:23.468119 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23fd2e-b152-42f4-a03c-5e25f706fa07 service placement] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:23.532706 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:23.533563 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:23.533901 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:23.534235 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] PATH_INFO: `/v3/projects/3375efa028844ac6aa1387456911155d` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:23.535676 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3375efa028844ac6aa1387456911155d)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:23.538348 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:23.599744 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3375efa028844ac6aa1387456911155d', 'request_id': 'req-697c183b-9e2e-4878-892e-85c61bf33ce7'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.606325 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3375efa028844ac6aa1387456911155d', 'request_id': 'req-697c183b-9e2e-4878-892e-85c61bf33ce7'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.607331 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:19:23.613493 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3375efa028844ac6aa1387456911155d', 'request_id': 'req-697c183b-9e2e-4878-892e-85c61bf33ce7'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.638008 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] The token cache is being invalidate because project 3375efa028844ac6aa1387456911155d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 14:19:23.638294 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.638913 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.640522 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 630/1260] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Aug 22 14:19:23 2022] DELETE /identity/v3/projects/3375efa028844ac6aa1387456911155d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:19:23.644855 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:23.646481 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:23.661018 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608ff70-ca2d-47cc-b9bf-6a11eb82fc2b admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:23.700703 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:19:23.731984 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:23.732630 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:23.732927 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:23.733439 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] PATH_INFO: `/v3/users/7da2f1a2b8124d659d9d37362dd78f9b` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:23.751647 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da2f1a2b8124d659d9d37362dd78f9b)` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:23.753776 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:23.818134 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da2f1a2b8124d659d9d37362dd78f9b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.828760 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da2f1a2b8124d659d9d37362dd78f9b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.829640 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da2f1a2b8124d659d9d37362dd78f9b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.830304 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da2f1a2b8124d659d9d37362dd78f9b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.838521 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.notifications [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da2f1a2b8124d659d9d37362dd78f9b'} {{(pid=88413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:23.856504 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 631/1261] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Aug 22 14:19:23 2022] DELETE /identity/v3/users/7da2f1a2b8124d659d9d37362dd78f9b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:19:24.065842 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Authenticating user token {{(pid=88414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:19:24.067319 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.fernet_utils [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:19:24.091480 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c183b-9e2e-4878-892e-85c61bf33ce7 admin admin] Validating token access rules against request {{(pid=88414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:19:24.185008 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8875dd4e092c4727887ccb9579eeb3e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa389fb5583459aa825686b80b028ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:19:24.185839 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:19:24.186203 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:19:24.186693 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] PATH_INFO: `/v3/projects/e6e88c215d404594a290f857a00c5439` {{(pid=88414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:19:24.201418 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e88c215d404594a290f857a00c5439)` {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:19:24.204159 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] RBAC: Authorization granted {{(pid=88414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:19:24.267304 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e88c215d404594a290f857a00c5439', 'request_id': 'req-0507ed85-8405-45f0-beac-c5d883cdf8ca'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:24.272882 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e88c215d404594a290f857a00c5439', 'request_id': 'req-0507ed85-8405-45f0-beac-c5d883cdf8ca'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:24.280139 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e88c215d404594a290f857a00c5439', 'request_id': 'req-0507ed85-8405-45f0-beac-c5d883cdf8ca'} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:24.301054 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] The token cache is being invalidate because project e6e88c215d404594a290f857a00c5439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 14:19:24.301496 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:24.302379 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG keystone.notifications [None req-0507ed85-8405-45f0-beac-c5d883cdf8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 14:19:24.304805 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: [pid: 88414|app: 0|req: 631/1262] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Aug 22 14:19:24 2022] DELETE /identity/v3/projects/e6e88c215d404594a290f857a00c5439 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 14:19:33.852433 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:19:34.296180 dv-osbrick-849020-5-ceph devstack@keystone.service[88414]: DEBUG dbcounter [-] [88414] Writing DB stats keystone:SELECT=59,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 14:23:30.771813 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Authenticating user token {{(pid=88413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 14:23:30.773533 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:23:30.858167 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878122-1522-48de-b85a-83b057809b1e admin admin] Validating token access rules against request {{(pid=88413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 14:23:30.925879 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3cda72513b4690a3b51e81d50a0344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05fe66912a0f4de3b5a751774422a074', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 14:23:30.926489 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] REQUEST_METHOD: `GET` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 14:23:30.926765 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] SCRIPT_NAME: `/identity` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 14:23:30.927034 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 14:23:30.929206 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.fernet_utils [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 14:23:30.940651 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 14:23:30.942275 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff92d9-7c02-4c9a-bc77-b8707d4621b1 service placement] RBAC: Authorization granted {{(pid=88413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 14:23:30.952070 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: [pid: 88413|app: 0|req: 632/1263] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Aug 22 14:23:30 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 14:23:40.948068 dv-osbrick-849020-5-ceph devstack@keystone.service[88413]: DEBUG dbcounter [-] [88413] Writing DB stats keystone:SELECT=62 {{(pid=88413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}